JP6089181B2 - Data input system, information processing apparatus, information processing program, and method thereof - Google Patents

Description

  The present invention relates to a data input system, an information processing apparatus, an information processing program, and a method thereof.

  Opportunities for persons with disabilities to be employed in companies and public institutions are increasing. Many disabled persons employed by companies and the like are engaged in data input work to an electronic computer such as a personal computer using a keyboard. However, data entry work using the keyboard, regardless of the degree of disability, places a heavy burden on the handicapped person, which not only reduces work efficiency due to the handicapped person's physical burden, but also secondary effects such as headache or stiff shoulders. May cause physical disabilities to persons with disabilities.

  2. Description of the Related Art There is known a data input system for a handicapped person for a handicapped person to perform data input work without using a keyboard. For example, Non-Patent Document 1 discloses a data input for a handicapped person who performs a data input operation using Wii (registered trademark) Remote by turning on an infrared LED device arranged on a key arrangement image of a printed-out keyboard. The system is described. In the data input system for persons with disabilities described in Non-Patent Document 1, since the data input system is configured using Wii (registered trademark) Remote, which is relatively inexpensive, it is possible to realize the data input system at a low cost. it can. Moreover, in the data input system for persons with disabilities described in Non-Patent Document 1, data input operation is performed on the key layout image of the printed keyboard, so that customization such as reduction / enlargement of the keyboard is easy.

  A data input system that uses a portable terminal having a display unit as a user interface is also known. Patent Document 1 describes a data input system that inputs data to a computer from a pen digitizer equipped with a data input application. Patent Document 2 describes a data input system for medical support that can access a hospital terminal, which is a personal computer installed with a program for electronic medical records, from a smartphone in which a dedicated application for the medical support system is installed. Is done.

Special table 2007-511003 gazette JP 2014-48858 A

"Research on input support for upper limb disabled", Tadaaki Kuraku, Katsumi Onishi, Hideo Nakano, Journal of Infomatics 8 (1), 2011

  However, in the data input system described in Non-Patent Document 1, it is necessary to prepare a dedicated infrared LED device in order to perform a data input operation on the printed key arrangement. In addition, in the data input system described in Non-Patent Document 1, it is necessary to calibrate each time the positional relationship between the Wii (registered trademark) Remote and the printed key layout is changed. The use position must be fixed. Furthermore, in the data input system described in Non-Patent Document 1, it is necessary to turn on the infrared LED by pressing a switch arranged in the infrared LED device, but the operation of pressing the switch with a finger moves the finger. There is a problem that it is difficult for people with disabilities who are not easy to use.

  In Patent Documents 1 and 2, since it is necessary to install an interface application for inputting information to the mobile terminal, it is necessary to develop an interface application for each OS (Operating System) of the mobile terminal. In Patent Documents 1 and 2, since it is necessary to develop an interface application for each type of mobile terminal, the development cost may increase.

  An object of this invention is to provide the data input system which can solve these problems. That is, according to the present invention, it is possible to input data using a mobile terminal that a user normally uses without using an interface application that is different for each OS of the dedicated device and the mobile terminal that requires development cost and purchase cost. An object is to provide a data input system.

  A data input system according to the present invention includes a mobile terminal and an information processing apparatus that communicates with the mobile terminal, and the mobile terminal displays a touch panel that displays a key arrangement image and coordinate information that indicates a touched position of the touch panel. The information processing apparatus includes a coordinate information generation unit that generates coordinate information and a coordinate information supply unit that supplies coordinate information, and the information processing apparatus acquires character information corresponding to the key arrangement image. A conversion unit that converts the data into a character string; and an information display unit that displays characters indicated by the character data acquired from the conversion unit.

  Furthermore, the data input system according to the present invention includes an update image generation unit that generates an update image that is an image obtained by changing the key arrangement of the key arrangement image displayed on the touch panel from the coordinate information, and the update image is transmitted to the mobile terminal. And an image supply unit that supplies the image data.

  Furthermore, in the data input system according to the present invention, the information processing apparatus further includes an image update unit that determines whether to update an image displayed on the touch panel, and the image supply unit includes the image update unit on the touch panel. When it is determined that the displayed image is to be updated, the updated image can be supplied to the mobile terminal.

  Further, in the data input system according to the present invention, the image update unit compares the image supplied by the image supply unit with the update image, and the image supplied by the image supply unit does not match the update image. It can be determined that the image displayed on the touch panel is updated.

  Furthermore, in the data input system according to the present invention, the image update unit compares a part of the image previously supplied by the image supply unit with a corresponding part of the update image, and when the compared parts do not match, It can be determined that the image displayed on the touch panel is updated.

  Furthermore, in the data input system according to the present invention, the key array image has a plurality of rectangular input keys arranged along the first direction and is spaced apart from each other by the same length as the side length of the input key. Can include a plurality of input key strings arranged in the.

  Further, in the data input system according to the present invention, the update image includes a pair of input keys arranged between a plurality of input key strings and spaced apart from each other by the same length as the side of the input key. Can be included.

  Furthermore, in the data input system according to the present invention, the plurality of input keys arranged in the first direction can be changed to reduce the size if the arrangement pitch is maintained.

  In addition, an information processing apparatus according to the present invention includes a touch panel that displays a key arrangement image, a coordinate information receiving unit that acquires coordinate information from a portable terminal that generates coordinate information indicating a touched position of the touch panel, and a coordinate It has a conversion part which converts information into character data corresponding to a key arrangement image, and an information display part which displays a character which character data acquired from a conversion part shows.

  The computer program according to the present invention has a touch panel that displays a key arrangement image, acquires coordinate information from a portable terminal that generates coordinate information indicating a touched position of the touch panel, and converts the coordinate information into the key arrangement image. Character data conversion is performed, character data is output, and processing is executed by a data processing unit.

  In the information processing method according to the present invention, the mobile terminal displays a key array image on the touch panel, the mobile terminal generates coordinate information indicating the touched position of the touch panel, and the mobile terminal receives the coordinate information. The information processing apparatus converts the coordinate information into character data corresponding to the key arrangement image, and the information processing apparatus displays the character indicated by the character data on the information display unit. To do.

  In the information processing method according to the present invention, the mobile terminal displays a key arrangement image on the touch panel, generates first coordinate information indicating a first tapped position of the touch panel, and uses the first coordinate information as the information processing apparatus. The information processing apparatus generates an update image including a key arrangement different from the key arrangement of the key arrangement image from the first coordinate information, and supplies the update image to the mobile terminal. Display, generate second coordinate information indicating the second tapped position of the touch panel, supply the second coordinate information to the information processing device, and the information processing device updates the second coordinate information to the second coordinate information. And the character data indicated by the character data is displayed on the information display unit of the information processing apparatus.

  In the data input system according to the present invention, it is possible to input data using a mobile terminal that is normally used by a user.

1 is a schematic perspective view of a data input system according to an embodiment. It is a figure which shows an example of schematic structure of the data input system which concerns on embodiment. It is a figure which shows an example of schematic structure of the personal computer shown in FIG. It is a figure which shows an example of schematic structure of the portable terminal shown in FIG. It is a figure which shows an example of the operation | movement sequence of the process which displays an initial image on the touch panel of the portable terminal shown in FIG. It is a figure which shows an example of the initial image displayed on the touch panel shown in FIG. It is a figure which shows an example of the operation | movement sequence of the character display process in the data input system which concerns on embodiment. It is a flowchart which shows an example of an update image generation process. It is a figure which shows an example of an update image. It is a flowchart which shows an example of a character data generation process. It is a figure which shows an example of the operation | movement sequence of the input mode switching process in the data input system which concerns on embodiment. It is a figure which shows an example of the 1st update image produced | generated by the input mode switching process. It is a figure which shows the example of the 2nd update image produced | generated by the input mode switching process, (a) shows an example of a 2nd update image, (b) shows the other example of a 2nd update image, 2nd It is a figure which shows the further another example of an update image. It is a figure which shows the other example of the 1st update image produced | generated by the input mode switching process, (a) is the 1st partial enlarged view of the other example of the 1st update image, (b) is the 1st update. It is the 2nd partial enlarged view of other examples of an image, and (c) is the 3rd partial enlarged view of other examples of the 1st update picture. It is a figure which shows an example of the 1st update image produced | generated by the key arrangement | sequence change process. It is a figure which shows the example of the 2nd update image produced | generated in a key arrangement | sequence change process, (a) shows an example of a 2nd update image, (b) is a figure which shows the other example of a 2nd update image. . It is a figure which shows an example of the operation | movement sequence of a key arrangement customization process. (A) is a figure which shows the 2nd update image in a key arrangement customization process, (b) is a figure which shows the example of the 3rd update image in a key arrangement customization process. It is a figure which shows an example of the operation | movement sequence of the mouse pointer movement process in the data input system which concerns on embodiment. It is a flowchart which shows an example of a mouse pointer movement data generation process. It is a figure which shows an example of the operation | movement sequence of the key size change process in the data input system which concerns on embodiment. It is a figure which shows an example of the update image produced | generated in a key size change process. It is a flowchart which shows an example of an image monitoring process.

  Hereinafter, a data input system, an information processing apparatus, an information processing program, and a method thereof according to the present invention will be described with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to these embodiments, and extends to equivalents to the invention described in the claims. Hereinafter, components having the same reference numerals in different drawings mean components having the same functions.

[Outline of Data Input System According to Embodiment]
FIG. 1 is a schematic perspective view of a data input system according to an embodiment.

  The data input system 1 is a system in which data is input by an upper limb disabled person 100. The data input system 1 includes a personal computer 2 and a portable terminal 3 connected to the personal computer 2 via the WWW (World Wide Web). The personal computer 2 includes an information display unit 203 and an information processing unit 210. The mobile terminal 3 has a touch panel 304. An application image 261 is displayed on the information display unit 203 of the personal computer 2, and a key layout image 321 of a software keyboard (also referred to as a soft keyboard) is displayed on the touch panel 304 of the mobile terminal 3.

  The upper limb handicapped person 100 operates the touch panel 304 of the portable terminal 3 on which the key arrangement image 321 of the software keyboard is displayed via the web browser without touching the keyboard. Enter. The portable terminal 3 acquires coordinate information indicating the position where the touch panel 304 is tapped. Then, the portable terminal 3 supplies the acquired coordinate information to the information processing unit 210 of the personal computer 2. The information processing unit 210 acquires coordinate information supplied from the mobile terminal 3 and converts the acquired coordinate information into an input event to the software keyboard. Next, the information processing unit 210 performs processing according to the input event using the software keyboard, and converts the input event into character data. Then, the personal computer 2 outputs the converted character data to the information display unit 203 via an application corresponding to the application image 261. The information display unit 203 of the personal computer 2 displays the characters indicated by the input character data.

  In the data input system 1, the disabled person 100 can input information by using the touch panel 304 of the mobile terminal 3 without using the keyboard, so that data can be input without pressing a key on the keyboard. It is. In the data input system 1, a software keyboard mounted on the personal computer 2 is used, and the mobile terminal 3 is not mounted with a software keyboard, but only with a web browser. The disabled person 100 who uses the data input system 1 can use the software keyboard by using the web browser installed in the mobile terminal 3 without installing the software keyboard in the mobile terminal 3 owned by the person. In the data input system 1, since the software keyboard is not mounted on the mobile terminal 3, it is not necessary to prepare a software keyboard for each OS (Operating System) mounted on the mobile terminal 3. Cost can be reduced.

[Configuration of Data Input System According to Embodiment]
FIG. 2 is a diagram illustrating an example of a schematic configuration of the data input system 1.

  In the data input system 1, exchanges (not shown) are connected to each other via a communication network 5 that is a wide area communication network. The exchange connects a wireless communication network covering a certain area to the communication network 5. In the wireless communication network, the base station 4 is arranged so as to manage a wireless zone covering the area. The base station 4 is connected to the exchange via a radio network controller (not shown) to which the base station 4 belongs. When the mobile terminal 3 in the area communicates with the personal computer 2 or the like, the mobile terminal 3 is connected to the exchange via the base station 4 and further connected to the communication network 5.

  The communication network 5 is connected to the intranet 6 through a gateway (not shown) by a wired LAN such as Ethernet (registered trademark). A personal computer 2 is further connected to the intranet 6.

  FIG. 3 is a diagram illustrating an example of a schematic configuration of the personal computer 2.

  The personal computer 2 is an information processing apparatus capable of various information processing, and includes an information communication unit 201, an information storage unit 202, an information display unit 203, an information input unit 204, and an information processing unit 210.

  The information communication unit 201 includes a wired communication interface circuit such as Ethernet (registered trademark). The information communication unit 201 communicates with the mobile terminal 3 and the like via the intranet 6. Then, the information communication unit 201 supplies data received from the mobile terminal 3 or the like to the information processing unit 210. Further, the information communication unit 201 transmits the data supplied from the information processing unit 210 to the mobile terminal 3 or the like.

  The information storage unit 202 includes, for example, at least one of a semiconductor memory, a magnetic disk device, and an optical disk device. The information storage unit 202 stores a driver program, an operating system program, an application program, data, and the like used for processing by the information processing unit 210. For example, the information storage unit 202 stores a communication device driver program that controls the information communication unit 201 as a driver program. The information storage unit 202 also stores a connection control program or the like using a communication method such as TCP / IP (Transmission Control Protocol / Internet Protocol) as an operating system program. The information storage unit 202 stores a software keyboard as an application program and a data processing program for transmitting and receiving various data. The computer program may be installed in the information storage unit 202 using a known setup program or the like from a computer-readable portable recording medium such as a CD-ROM or DVD-ROM.

  The information processing unit 210 has one or a plurality of processors and their peripheral circuits. The information processing unit 210 controls the overall operation of the personal computer 2 and is, for example, a CPU. The information processing unit 210 controls the operation of the information communication unit 201 and the like so that various processes of the personal computer 2 are executed in an appropriate procedure according to a program stored in the information storage unit 202. The information processing unit 210 executes processing based on programs (driver program, operating system program, application program, etc.) stored in the information storage unit 202. Further, the information processing unit 210 can execute a plurality of programs (such as application programs) in parallel.

  The information processing unit 210 includes a communication control unit 220, a coordinate information conversion unit 230, an event conversion unit 240, an image update unit 250, and an information display application 260. The communication control unit 220 includes a coordinate information acquisition unit 221 and an image supply unit 222. The event conversion unit 240 includes a character data conversion unit 241 and an update image generation unit 242. Each of these units included in the information processing unit 210 is a functional module implemented by a program executed on a processor included in the information processing unit 210. Alternatively, these units included in the information processing unit 210 may be mounted on the personal computer 2 as independent integrated circuits, microprocessors, or firmware.

  FIG. 4 is a diagram illustrating an example of a schematic configuration of the mobile terminal 3.

  The mobile terminal 3 is an example of a terminal and is, for example, a multi-function mobile phone (so-called “smart phone”), and enables connection to a wireless communication network, short-range wireless communication, execution of a predetermined application program, and the like. For this purpose, the mobile terminal 3 includes a terminal communication unit 301, a short-range terminal communication unit 302, a terminal operation unit 303, a touch panel 304, a terminal storage unit 305, and a terminal processing unit 310. The mobile terminal 3 may be a communication device having a communication function, and may be, for example, a mobile terminal (Personal Digital Assistant, PDA), a mobile game machine, a mobile music player, a tablet PC, or the like.

  The terminal communication unit 301 includes a communication interface circuit including an antenna mainly having a 2.1 GHz band as a sensitive band, and connects the mobile terminal 3 to the communication network 5. The terminal communication unit 301 establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station 4 via a channel assigned by the base station 4, and performs radio communication with the base station 4. I do. Then, the terminal communication unit 301 supplies the data received from the base station 4 to the terminal processing unit 310. In addition, the terminal communication unit 301 transmits the data supplied from the terminal processing unit 310 to the base station 4. The terminal communication unit 301 performs data communication with the personal computer 2 in accordance with an HTTP (Hypertext Transfer Protocol) protocol. The terminal communication unit 301 has a communication interface circuit including an antenna mainly having a 2.4 GHz band as a sensitive band, and a wireless LAN base station such as Wi-Fi (registered trademark) without using the base station 4. Wireless communication is performed via

  The short-range terminal communication unit 302 has an interface circuit for performing short-range wireless communication in accordance with a communication method such as Bluetooth LE (Low Energy) (registered trademark), and is close to other portable terminals 3 and the like. Performs range wireless communication. Then, the short-range terminal communication unit 302 supplies data received from another mobile terminal 3 or the like to the terminal processing unit 310. In addition, the short-range terminal communication unit 302 transmits the data supplied from the terminal processing unit 310 to another mobile terminal 3 or the like. Note that the short-range terminal communication unit 302 may include an interface circuit for performing short-range wireless communication according to another communication method such as Bluetooth (registered trademark), RFID (Radio Frequency IDentification), or ZigBee.

  The terminal operation unit 303 may be any device as long as the mobile terminal 3 can be operated, such as a keypad. The user can input letters, numbers, and the like using this device. The terminal operation unit 303 receives a user instruction, generates a signal corresponding to the received instruction, and outputs the signal to the terminal processing unit 310.

  The touch panel 304 may be any device that can output a moving image, a still image, and the like, and is, for example, a touch panel display device. The touch panel 304 displays a moving image corresponding to the moving image data supplied from the terminal processing unit 310, a still image corresponding to the still image data, and the like. The touch panel 304 receives a user instruction by touch such as tapping, dragging, and flicking, generates a signal corresponding to the received instruction, and outputs the signal to the terminal processing unit 310.

  The terminal storage unit 305 includes, for example, a semiconductor memory. The terminal storage unit 305 stores a driver program, an operating system program, an application program, data, and the like used for processing in the terminal processing unit 310. For example, the terminal storage unit 305 includes, as driver programs, a mobile phone communication device driver program that controls the terminal communication unit 301, a wireless LAN communication device driver program, a short-range wireless communication device driver program that controls the short-range terminal communication unit 302, An input device driver program for controlling the terminal operation unit 303, an output device driver program for controlling the touch panel 304, and the like are stored. In addition, the terminal storage unit 305 stores, as an operating system program, a connection control program that executes a Bluetooth LE (registered trademark) standard short-range wireless communication system, a connection control program for mobile phones and wireless LANs, and the like. Further, the terminal storage unit 305 stores various programs including a web browser program that acquires and displays a web page as an application program. The computer program may be installed in the terminal storage unit 305 using a known setup program or the like from a computer-readable portable recording medium such as a semiconductor memory including a flash memory.

  Further, the terminal storage unit 305 stores, as data, a user ID that is user identification information of the mobile terminal 3, an address for accessing the personal computer 2, and the like. Further, the terminal storage unit 305 may temporarily store temporary data related to a predetermined process.

  The terminal processing unit 310 includes one or a plurality of processors and their peripheral circuits. The terminal processing unit 310 controls the overall operation of the portable terminal 3 and is, for example, a CPU (Central Processing Unit). The terminal processing unit 310 is configured so that various processes of the mobile terminal 3 are executed in an appropriate procedure according to a program stored in the terminal storage unit 305, operations of the terminal operation unit 303, the touch panel 304, and the like. 301, controls the operation of the short-range terminal communication unit 302 and the like. The terminal processing unit 310 executes processing based on programs (driver program, operating system program, application program, etc.) stored in the terminal storage unit 305. In addition, the terminal processing unit 310 can execute a plurality of programs (such as application programs) in parallel.

  The terminal processing unit 310 includes an image setting unit 311, a coordinate information generation unit 312, and a coordinate information supply unit 313. Each of these units included in the terminal processing unit 310 is a functional module implemented by a program executed on a processor included in the terminal processing unit 310. Alternatively, these units included in the terminal processing unit 310 may be mounted on the portable terminal 3 as independent integrated circuits, microprocessors, or firmware.

[Initialization Processing of Data Input System According to Embodiment]
FIG. 5 is a diagram illustrating an example of an operation sequence of processing for displaying an initial image on the touch panel 304 of the mobile terminal 3.

  The operation sequence described below is executed in cooperation with each element of each device mainly by the control unit of each device based on a program stored in advance in the storage unit of each device.

  First, the image setting unit 311 of the mobile terminal 3 displays a web browser on the touch panel 304 in accordance with the instruction of the upper limb disabled person 100 via the touch panel 304 (S101). Next, the image setting unit 311 of the portable terminal 3 accepts a URL (Uniform Resource Locator) of the personal computer 2 input from the upper limb handicapped person 100 to the web browser of the touch panel 304. (S102). Next, the image setting unit 311 of the portable terminal 3 transmits an initial image request signal to the personal computer 2 via the terminal communication unit 301 (S103).

  In response to the initial image request signal, the image supply unit 222 of the personal computer 2 supplies initial image data corresponding to the initial image of the key layout of the software keyboard to the portable terminal 3 (S104). Next, the image setting unit 311 of the mobile terminal 3 acquires an initial image indicated by the initial image data received by the terminal communication unit 301. When acquiring the initial image indicated by the initial image data, the image setting unit 311 of the portable terminal 3 displays the acquired initial image on the touch panel 304 via a web browser (S105).

  FIG. 6 is a diagram illustrating an example of an initial image displayed on the touch panel 304.

  The initial image 400 is displayed on the touch panel 304 via a web browser. The initial image 400 includes a character input key group 401 including a plurality of character input keys, a shift key 402, a space key 403, an enter key 404, a backspace key 405, and a cursor key 406. The initial image 400 includes two shortcut keys 410, an input mode switching key 411, a customization key 412, a function key 413, and a key size change key 414. Each of these input keys has a square shape. The initial image 400 further includes an input content display unit 430.

  The “A” key to “HA” key and enter key 404 of the character input key group 401 form a first input key row 421, and the “MA” key to “SYMBOL” key, shift key 402 and space key of the character input key group 401. 403 forms a second input key row 422. The cursor key 406, the shortcut key 410, the input mode switching key 411, the customize key 412, and the function key 413 form a third input key row 423. Each of the first input key row 421, the second input key row 422, and the third input key row 423 has a plurality of input keys arranged along the horizontal direction. The interval between the first input key row 421 and the second input key row 422 and the interval between the first input key row 421 and the third input key row 423 are the length of the side of the input key displayed in the initial image 400. Have the same length.

  Each of the character input keys included in the character input key group 401 is used when determining a character to be input by two-tap input. Each of the “A” key to “WA” key of the character input key group 401 is used when inputting hiragana characters in each line. “Small” in the character input key group 401 is used when inputting muddy sounds, semi-voiced sounds and small letters, and the “symbol” key is used when inputting symbols.

  The input content display unit 430 temporarily displays a character string input by the upper limb handicapped person 100 by operating the touch panel 304. The character string displayed on the input content display unit 430 is cleared by tapping the enter key 404 or switching the input mode using the input mode switching key 411.

  An area where the image setting unit 311 of the portable terminal 3 displays an image is an area 440 used for moving a mouse pointer displayed on the information display unit 203.

[Character Input Processing in Data Input System According to Embodiment]
FIG. 7 is a diagram illustrating an example of an operation sequence of processing for inputting characters by two-tap input on the touch panel 304 of the mobile terminal 3 and displaying characters on the information display unit 203 of the personal computer 2.

  The operation sequence described below is executed in cooperation with each element of each device mainly by the control unit of each device based on a program stored in advance in the storage unit of each device.

  First, the touch panel 304 detects a first tap that is one of the character input keys included in the character input key group 401 of the initial image 400 (S201), and the coordinates on the touch panel 304 of the first tap are coordinate information. This is supplied to the generation unit 312. The coordinate information generation unit 312 generates first coordinate information which is coordinates on the web browser of the first tap from the coordinates on the touch panel 304 of the first tap acquired from the touch panel 304 (S202). The coordinate information supply unit 313 transmits a first coordinate information signal corresponding to the first coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S203).

  When receiving the first coordinate information signal, the personal computer 2 generates an update image corresponding to the first coordinate information indicated by the received first coordinate information signal (S204). The updated image is an image obtained by changing the key arrangement of the key arrangement image displayed on the touch panel 304.

  FIG. 8 is a flowchart illustrating an example of a process for generating an update image in S204.

  The coordinate information acquisition unit 221 acquires first coordinate information indicated by the received first coordinate information signal (S301). Next, the coordinate information conversion unit 230 converts the first coordinate information acquired by the coordinate information acquisition unit 221 into a first input event that can be read by the event conversion unit 240 (S302). The coordinate information conversion unit 230 estimates from the first coordinate information indicating the coordinates of the web browser which part of the touch panel 304 of the mobile terminal 3 corresponds to which key of the image of the event conversion unit 240 has been tapped. The coordinate information conversion unit 230 generates an input event indicating that the key corresponding to the estimated tap position has been tapped. The coordinate information conversion unit 230 supplies the generated first input event to the event conversion unit 240.

  When the first input event is supplied, the update image generation unit 242 of the event conversion unit 240 generates an update image corresponding to the supplied first input event (S303). Next, the image supply unit 222 supplies the updated image 500 to the information communication unit 201 (S304).

  FIG. 9 is a diagram illustrating an example of an update image generated by the update image generation unit 242. The update image shown in FIG. 9 is an update image generated when the supplied first input event indicates that the “A” key of the character input key group has been tapped.

  The update image 500 includes “A” key 501 to “O” key 505 corresponding to the five characters in the row expanded so as to be selectable. The “I” key 502 and the “U” key 503 are arranged between the first input key row 421 and the third input key row 423 so as to be separated from each other by the same length as the side length of the input key. . Further, the “e” key 504 and the “o” key 505 are arranged between the first input key row 421 and the second input key row 422 so as to be separated from each other by the same length as the side length of the input key. Is done. In the updated image 500, the "A" key 501 to the "O" key 505 are expanded so that they can be selected. When the "KA" key is tapped, the "KA" key to the "KO" key can be selected. It is developed like that. Similarly, when the “sa” key to the “wa” key are tapped, characters on each line are expanded so that they can be selected. When “゛” is tapped, input keys that can select muddy sounds, semi-voiced sounds, and small letters are expanded. When “symbol” is tapped, for example, a punctuation mark, a punctuation mark, a right parenthesis, Input keys that can be selected by each left parenthesis are expanded.

  The information communication unit 201 transmits update image data corresponding to the update image 500 to the mobile terminal (S205). Next, the image setting unit 311 of the mobile terminal 3 acquires the update image 500 indicated by the update image data received by the terminal communication unit 301. When acquiring the updated image 500, the image setting unit 311 of the portable terminal 3 displays the updated image 500 on the touch panel 304 via the web browser (S206).

  Next, the touch panel 304 detects a second tap, which is one of the character input keys expanded so that the update image 500 can be selected (S207), and the coordinates on the touch panel 304 of the second tap are detected as a coordinate information generation unit. 312 is supplied. The coordinate information generation unit 312 generates second coordinate information that is coordinates on the web browser of the second tap from the coordinates on the touch panel 304 of the second tap acquired from the touch panel 304 (S208). The coordinate information supply unit 313 transmits a second coordinate information signal corresponding to the second coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S209).

  When receiving the second coordinate information signal, the personal computer 2 generates character data corresponding to the second coordinate information indicated by the received second coordinate information signal (S210).

  FIG. 10 is a flowchart illustrating an example of processing for generating character data in S210.

  The coordinate information acquisition unit 221 acquires second coordinate information indicated by the received second coordinate information signal (S401). Next, the coordinate information conversion unit 230 converts the second coordinate information acquired by the coordinate information acquisition unit 221 into a second input event that can be read by the event conversion unit 240 (S402). The coordinate information conversion unit 230 supplies the generated second input event to the event conversion unit 240. When the second input event is supplied, the character data conversion unit 241 of the event conversion unit 240 converts the supplied second input event into character data (S403). For example, when the supplied second input event indicates that the “I” key expanded so that the update image 500 can be selected is tapped, the character data conversion unit 241 displays the second event as “I”. Is converted to character data indicating. Next, the character data conversion unit 241 supplies the converted character data to the information display unit 203 (S404).

  Next, the information display unit 203 displays the characters indicated by the supplied character data (S211). For example, when the supplied character data is character data indicating “I”, the character data conversion unit 241 displays the image indicating “I” as an active application in the information display unit 203. "I" is displayed on the image.

  Next, a process similar to the process described with reference to FIG. 8 is executed to generate a second updated image corresponding to the second coordinate information indicated by the received second coordinate information signal (S212). Here, the update image generation unit 242 of the event conversion unit 240 generates the initial image 400 according to the supplied second input event (S303). Next, the image supply unit 222 supplies the initial image 400 to the information communication unit 201 (S304). Next, the information communication unit 201 transmits initial image data corresponding to the initial image 400 to the portable terminal (S213). And the image setting part 311 of the portable terminal 3 will display the initial image 400 on the touch panel 304 via a web browser, if the initial image 400 is acquired (S214).

[Input Mode Switching Process in Data Input System According to Embodiment]
FIG. 11 is a diagram illustrating an example of an operation sequence of processing for switching the input mode by tapping the input mode switching key 411 on the touch panel 304 of the mobile terminal 3.

  The operation sequence described below is executed in cooperation with each element of each device mainly by the control unit of each device based on a program stored in advance in the storage unit of each device.

  First, the touch panel 304 detects a first tap that is a tap of the input mode switching key 411 (S501), and supplies the coordinates on the touch panel 304 of the first tap to the coordinate information generation unit 312. The coordinate information generation unit 312 generates first coordinate information, which is coordinates on the web browser of the first tap, from the coordinates on the touch panel 304 of the first tap acquired from the touch panel 304 (S502). The coordinate information supply unit 313 transmits a first coordinate information signal corresponding to the first coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S503).

  When the personal computer 2 receives the first coordinate information signal, the personal computer 2 executes a process similar to the process described with reference to FIG. 8 and performs first processing corresponding to the first coordinate information indicated by the received first coordinate information signal. An updated image is generated (S504).

  FIG. 12 is a diagram illustrating an example of a first update image generated by the update image generation unit 242 in the input mode switching process.

  The first updated image 600 includes an input mode switching key 601 expanded so as to be selectable, a katakana input key 602, an alphabetic input key 603, and a number input key 604. The katakana input key 602 is disposed between the third input key row 423 and the backspace key 405. Further, the alphabetic input key 603 and the numeric input key 604 are arranged between the first input key row 421 and the third input key row 423 so as to be separated from each other by the same length as the side length of the input key. .

  The information communication unit 201 transmits the first update image data corresponding to the first update image 600 to the mobile terminal (S505). Next, the image setting unit 311 of the mobile terminal 3 acquires the first update image 600 indicated by the first update image data received by the terminal communication unit 301. When acquiring the first update image 600, the image setting unit 311 of the portable terminal 3 displays the first update image 600 on the touch panel 304 via a web browser (S506).

  Next, the touch panel 304 detects the second tap, which is one of the input keys 601 to 604 expanded so that the first update image 600 can be selected (S507), and the coordinates of the second tap on the touch panel 304 are detected. The coordinate information generation unit 312 is supplied. The coordinate information generation unit 312 generates second coordinate information that is coordinates on the web browser of the second tap from the coordinates on the touch panel 304 of the second tap acquired from the touch panel 304 (S508). The coordinate information supply unit 313 transmits a second coordinate information signal corresponding to the second coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S509).

  When the personal computer 2 receives the second coordinate information signal, the personal computer 2 executes a process similar to the process described with reference to FIG. 8 and performs second processing corresponding to the second coordinate information indicated by the received second coordinate information signal. An updated image is generated (S510). Next, the information communication unit 201 transmits second update image data corresponding to the second update image to the mobile terminal (S511). Next, the image setting unit 311 of the mobile terminal 3 acquires a second update image indicated by the second update image data received by the terminal communication unit 301. When acquiring the second update image, the image setting unit 311 of the mobile terminal 3 displays the second update image on the touch panel 304 via the web browser (S512).

  FIG. 13 is a diagram illustrating an example of the second update image generated by the update image generation unit 242 in the input mode switching process. FIG. 13A shows a second updated image when the katakana input key 602 is second tapped, and FIG. 13B shows a second updated image when the alphabetic input key 603 is tapped second, FIG. 13C is a diagram showing a second updated image when the numeric input key 604 is tapped for the second time. When the input mode switching key 601 is tapped for the second time, the updated image generation unit 242 of the event conversion unit 240 generates the same image as the initial image 400.

  A second update image 610 shown in FIG. 13A has a character input key group 611. Each of the “A” key to “W” key of the character input key group 611 is used when inputting katakana characters in each line. “Small” in the character input key group 611 is used when inputting muddy sounds, semi-voiced sounds and small letters, and the “symbol” key is used when inputting symbols.

  The second update image 620 shown in FIG. 13B has a character input key group 621. Each of the “abc” key to “wxyz” key of the character input key group 621 is used when inputting an alphabetic character indicated by the key. For example, the “abc” key is used when inputting a, b, and c. Each of the “symbol 1” key to “symbol 3” key of the character input key group 621 is used when inputting a symbol. In one example, the “symbol 1” key is used when entering “@”, “#”, “/”, “_”, and “&”, and the “symbol 2” key is “′”, “” ”, Used when entering “(” and “)”. The “symbol 3” key is used when inputting “.”, “,”, “?” And “!”.

  The second update image 630 shown in FIG. 13C has a character input key group 631. Each of the “1” key to “0” key of the character input key group 631 is used when inputting a number indicated by the key.

  FIG. 14 is a diagram illustrating another example of the first update image generated by the update image generation unit 242. FIG. 14A shows that the input mode switching process shown in FIG. 11 is executed when the second update image 610 having the character input key group 611 used when inputting katakana characters is displayed on the touch panel 304. It is the elements on larger scale of the 1st update image at the time. FIG. 14B shows that the input mode switching process shown in FIG. 11 is executed when the second updated image 620 having the character input key group 621 used when inputting English characters is displayed on the touch panel 304. It is the elements on larger scale of the 1st update image at the time. FIG. 14C shows that the input mode switching process shown in FIG. 11 is executed when the second update image 630 having the character input key group 631 used when inputting numbers is displayed on the touch panel 304. It is the elements on larger scale of the 1st update image at the time.

  The first update image 640, which is an update image when the second update image 610 shown in FIG. 13A is first tapped, includes an input mode switching key 641 expanded so as to be selectable, and a hiragana input key 642. And an alphabetic input key 643 and a numeric input key 644. The first update image 650, which is an update image when the second update image 620 shown in FIG. 13B is first tapped, includes an input mode switching key 651 expanded so as to be selectable, and a hiragana input key 652. And a full-width input key 653 and a numeric input key 654. The first update image 660, which is an update image when the second update image 630 shown in FIG. 13C is first tapped, includes an input mode switching key 661 developed so as to be selectable, and a hiragana input key 662. And an alphabetic input key 663 and a half-width input key 664.

[Key Arrangement Change Processing in Data Input System According to Embodiment]
When the customization key 412 is tapped first while the initial image 400 shown in FIG. 6 is displayed on the touch panel 304 of the mobile terminal 3, processing for customizing the key arrangement image of the software keyboard on the touch panel 304 is executed. . The key arrangement changing process is executed by the same process as the input mode switching process shown in FIG. That is, in the key arrangement changing process, the personal computer 2 generates a first updated image (S504) in response to detection of the first tap that is the tap of the customization key 412 (S501). And the image setting part 311 of the portable terminal 3 will display a 1st update image on the touch panel 304 via a web browser, if the 1st update image which the personal computer 2 produced | generated is acquired (S506).

  FIG. 15 is a diagram illustrating an example of a first update image generated by the update image generation unit 242 in the key arrangement changing process.

  The first updated image 700 includes a customization key 701 expanded so that it can be selected, a horizontal arrangement key 702, a vertical arrangement key 703, a self-made arrangement key 704, and a custom key 705. The horizontal direction key 702 and the vertical direction key 703 are arranged between the first input key row 421 and the third input key row 423 so as to be spaced apart from each other by the same length as the side length of the input key. . The self-made arrangement key 704 is arranged between the third input key row 423 and the backspace key 405, and the custom key 705 is arranged adjacent to the function key 413. The self-made arrangement key 704 and the custom key 705 are arranged to be separated from each other by the same length as the side of the input key.

  The information communication unit 201 transmits the first update image data corresponding to the first update image 700 to the mobile terminal (S505). Next, the image setting unit 311 of the mobile terminal 3 acquires the first update image 700 indicated by the first update image data received by the terminal communication unit 301. When acquiring the first update image 700, the image setting unit 311 of the portable terminal 3 displays the first update image 700 on the touch panel 304 via a web browser (S506).

  Next, the touch panel 304 detects a second tap, which is any one of the input keys 701 to 704 expanded so that the first update image 700 can be selected (S507). The coordinate information supply unit 313 transmits a second coordinate information signal corresponding to the second coordinate information corresponding to the position of the second tap to the personal computer 2 (S509), and the personal computer 2 receives the second coordinate information corresponding to the second coordinate information. An updated image is generated (S510). Then, the personal computer 2 transmits the second update image data corresponding to the second update image to the mobile terminal, and the image setting unit 311 of the mobile terminal 3 displays the second update image on the touch panel 304 via the web browser. (S512).

  FIG. 16 is a diagram illustrating an example of a second update image generated by the update image generation unit 242 in the key layout change process. FIG. 16A shows the second updated image when the vertical direction arrangement key 703 is tapped second, and FIG. 16B shows an example of the second updated image when the self-made arrangement key 704 is tapped second. FIG. When any one of the customization key 701 and the horizontal arrangement key 702 is tapped for the second time, the update image generation unit 242 of the event conversion unit 240 generates the same image as the initial image 400. In this case, the second updated image is the same image as the initial image 400.

  The second update image 710 shown in FIG. 16A includes a first input key string 711, a second input key string 712, and a third input key string 713. Each of the first input key row 711, the second input key row 712, and the third input key row 713 has a plurality of input keys arranged along the vertical direction. The distance between the first input key string 711 and the second input key string 712 and the distance between the second input key string 712 and the third input key string 713 are the same length as the side length of the input key. The first input key row 711 has “A” key to “HA” key, the second input key row 712 has “MA” key to enter key, and the third input key row 713 is shortcut key to backspace key. Have

  The second update image 720 shown in FIG. 16B has a first input key row 721, a second input key row 722, and a third input key row 723. Each of the first input key row 721, the second input key row 722, and the third input key row 723 has a plurality of input keys arranged along the horizontal direction. The distance between the first input key string 721 and the second input key string 722 and the distance between the second input key string 722 and the third input key string 723 are the same length as the side length of the input key. The first input key row 721 includes “A” key to “HA” key, the second input key row 722 includes “MA” key to “SYMBOL” key, and the third input key row 723 includes shortcut keys— Has a backspace key.

[Key Arrangement Customization Processing in Data Input System According to Embodiment]
FIG. 17 is a diagram illustrating an example of an operation sequence of key layout customization processing for changing the key layout of the key layout image of the software keyboard displayed on the touch panel 304 of the mobile terminal 3.

  The operation sequence described below is executed in cooperation with each element of each device mainly by the control unit of each device based on a program stored in advance in the storage unit of each device.

  The processing of S701 to S712 is the same as the processing of S501 to S512 shown in FIG. The first tap of S701 is a tap of the customization key 412 of the initial image 400 shown in FIG. 6, and the second tap of S707 is a tap of the custom key 705 of the first updated image 700 shown in FIG.

  FIG. 18A is a diagram showing a second update image when the custom key 705 of the first update image 700 shown in FIG. 15 is tapped second.

  The second updated image 810 includes a first input key row 811, a second input key row 812, a third input key row 813, a fourth input key row 814, and a custom key 815. Each of the first input key row 811, the second input key row 812, the third input key row 813, and the fourth input key row 814 includes a plurality of input keys arranged along the horizontal direction.

  If any of the input keys is subjected to the third tap and the fourth tap while the second updated image 810 is displayed, the personal computer 2 taps the display position of the input key that has been tapped for the fourth tap. An image moved to the specified position is generated. Next, the personal computer 2 supplies the generated image to the mobile terminal 3, and the mobile terminal 3 displays the supplied image on the touch panel 304.

  That is, the touch panel 304 detects the third tap that is one of the input keys of the second update image 810 and the fourth tap after the third tap (S713), and the touch panel 304 of the third tap and the fourth tap. The upper coordinates are supplied to the coordinate information generation unit 312. The coordinate information generation unit 312 is the third coordinate information and the fourth coordinate information which are the coordinates on the web browser of the third tap and the fourth tap from the coordinates on the touch panel 304 of the third tap and the fourth tap acquired from the touch panel 304. Is generated (S714). The coordinate information supply unit 313 transmits the third coordinate information signal and the fourth coordinate information signal corresponding to the third coordinate information and the fourth coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S715).

  When the personal computer 2 receives the third coordinate information signal and the fourth coordinate information signal, the personal computer 2 executes a process similar to the process described with reference to FIG. 8 and the second coordinate indicated by the received second coordinate information signal. A second updated image corresponding to the information is generated (S716). That is, the coordinate information acquisition unit 221 acquires the third coordinate information and the fourth coordinate information indicated by the received third coordinate information signal and fourth coordinate information signal (S301). Next, the coordinate information conversion unit 230 converts the third coordinate information and the fourth coordinate information acquired by the coordinate information acquisition unit 221 into a third input event and a fourth input event that can be read by the event conversion unit 240 (S302). . When the third input event and the fourth input event are supplied, the updated image generation unit 242 of the event conversion unit 240 moves to the position of the input key indicated by the third input event and the position indicated by the fourth input event. An updated image is generated (S303).

  FIG. 18B is a diagram illustrating an example of a third update image generated by the update image generation unit 242 in the key layout customization process. In the second update image 820 shown in FIG. 18B, the “a” key 816 is tapped third in the second update image 810, and the position where the “a” key 826 is located is tapped fourth. In this example, the display position of the “A” key 816 is moved to the display position of the “A” key 826.

  In the initial image 400 before the key layout customization process is executed, the “A” key is arranged in the first input key row 421. On the other hand, in the third updated image 820, an “A” key 826 is arranged at a position outside the first input key row 821.

  Next, the information communication unit 201 transmits third updated image data corresponding to the third updated image to the mobile terminal (S717). Next, the image setting unit 311 of the mobile terminal 3 acquires the third update image indicated by the third update image data received by the terminal communication unit 301, and displays the third update image on the touch panel 304 via the web browser ( S718).

[Mouse Pointer Movement Processing in Data Input System According to Embodiment]
FIG. 19 is a diagram illustrating an example of an operation sequence of a mouse pointer movement process for moving a mouse pointer displayed on the information display unit 203 by dragging the touch panel 304 of the mobile terminal 3.

  The operation sequence described below is executed in cooperation with each element of each device mainly by the control unit of each device based on a program stored in advance in the storage unit of each device.

  First, the touch panel 304 detects a drag (S801), and supplies the coordinates of the drag start point and end point on the touch panel 304 to the coordinate information generation unit 312. The coordinate information generation unit 312 generates drag coordinate information, which is coordinates on the drag web browser, from the drag start point and end point coordinates acquired from the touch panel 304 (S802). The coordinate information supply unit 313 transmits a drag coordinate information signal corresponding to the drag coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S803).

  When receiving the drag coordinate information signal, the personal computer 2 generates mouse pointer movement data corresponding to the drag coordinate information indicated by the received drag coordinate information signal (S804).

  FIG. 20 is a flowchart illustrating an example of processing for generating mouse pointer movement data in step S804.

  The coordinate information acquisition unit 221 acquires the drag coordinate information indicated by the received drag coordinate information signal (S901). Next, the coordinate information conversion unit 230 converts the drag coordinate information into mouse pointer movement data (S902). The mouse pointer movement data is calculated based on the drag direction and distance to the touch panel 304. For example, when the touch panel 304 is dragged horizontally from right to left by 1 cm, data indicating coordinates on the information display unit 203 indicating coordinates moved several centimeters rightward from the coordinates of the current mouse pointer are displayed on the mouse. Calculated as pointer movement data. Then, the coordinate information acquisition unit 221 supplies the converted mouse pointer movement data to the information display unit 203 (S903).

  Then, the information display unit 203 moves and displays the mouse pointer at the position indicated by the supplied mouse pointer movement data (S805).

  In the mouse pointer movement process, the same process as the input mode switching process shown in FIG. 11 may be executed using the drag start point as the first tap to display the “right click” key and the “left click” key. it can.

  In addition, the start and end points of the drag in the mouse pointer movement process are detected at regular intervals (for example, a short time within one second), and dragging on the touch panel 304 and movement of the mouse pointer on the information display unit 203 are performed. Can be linked in real time.

[Key Size Change Processing in Data Entry System According to Embodiment]
FIG. 21 shows an operation of a key size changing process in which the key size changing key 414 of the initial image 400 displayed on the touch panel 304 of the mobile terminal 3 is tapped to change the key size of the key arrangement image of the displayed software keyboard. It is a figure which shows an example of a sequence.

  The operation sequence described below is executed in cooperation with each element of each device mainly by the control unit of each device based on a program stored in advance in the storage unit of each device.

  First, the touch panel 304 detects a tap of any key of the key size change key 414 (S1001), and supplies the coordinates of the tap on the touch panel 304 to the coordinate information generation unit 312. The coordinate information generation unit 312 generates tap coordinate information, which is coordinates on the web browser of the tap, from the coordinates on the touch panel 304 of the tap acquired from the touch panel 304 (S1002). The coordinate information supply unit 313 transmits a tap coordinate information signal corresponding to the tap coordinate information generated by the coordinate information generation unit 312 to the personal computer 2 (S1003). When the personal computer 2 receives the tap coordinate information signal, the personal computer 2 executes processing similar to the processing described with reference to FIG. 8 and generates an updated image corresponding to the tap coordinate information indicated by the received tap coordinate information signal. (S1004).

  FIG. 22 is a diagram illustrating an example of an update image generated by the update image generation unit 242 in the key size change process. An update image 900 shown in FIG. 22 is an update image when the “size-” key is tapped.

  The updated image 900 includes a character input key group 901 including a plurality of character input keys, a shift key 902, a space key 903, an enter key 904, a backspace key 905, and a cursor key 906. The updated image 900 includes two shortcut keys 910, an input mode switching key 911, a customization key 912, a function key 913, and a key size change key 914. The updated image 900 further includes an input content display unit 930.

  The input keys displayed on the updated image 900 are changed so as to reduce the size while maintaining the arrangement pitch as compared with the input keys displayed on the initial image 400. That is, the input keys displayed in the update image 900 change the length of the side while maintaining the arrangement pitch of the input keys adjacent in the vertical direction and the horizontal direction. For example, the distance between the center of the customization key 912 and the center of the function key 913 is equal to the distance between the center of the customization key 412 and the center of the function key 413 in the initial image 400. The distance between the center of the customization key 912 and the “NA” key at the center of the character input key group 901 is the center of the customization key 412 of the initial image 400 and the center of the “NA” key of the character input key group 401. Is equal to the distance between

[Image Monitoring Processing in Data Input System According to Embodiment]
FIG. 23 is a flowchart illustrating an example of an image monitoring process for determining whether to update an image displayed on the touch panel 304 of the mobile terminal 3.

  The image monitoring process shown in FIG. 23 is started after the personal computer 2 receives the initial image request signal (S103). First, the image update unit 250 waits for a predetermined time (S1101). Next, the image update unit 250 compares the image previously supplied by the image supply unit 222 with the update image generated by the update image generation unit 242 and updates the image displayed on the touch panel 304 of the mobile terminal 3. It is determined whether or not (S1102). The image update unit 250 determines to update the image displayed on the touch panel 304 of the mobile terminal 3 when the image previously supplied by the image supply unit 222 and the update image generated by the update image generation unit 242 do not match. To do. When the image update unit 250 determines to update the image displayed on the touch panel 304 of the mobile terminal 3, the image supply unit 222 supplies the update image generated by the update image generation unit 242 to the information communication unit 201 (S1103). The process proceeds to S1104. Further, the image update unit 250 is a software keyboard displayed on the touch panel 304 of the mobile terminal 3 when the image previously supplied by the image supply unit 222 matches the update image generated by the update image generation unit 242. It is determined that the key arrangement image is not updated. If the image update unit 250 determines to update the image displayed on the touch panel 304 of the mobile terminal 3, the process proceeds to S1104.

  When the process proceeds to S1104, the image update unit 250 determines whether or not to end the image monitoring process. For example, when the web browser displaying the keyboard key arrangement image on the touch panel 304 of the mobile terminal 3 is closed and the image update unit 250 acquires the monitoring stop instruction supplied from the terminal processing unit 310, the image update unit 250 It is determined that the process is finished. When the image update unit 250 does not determine that the image monitoring process is to be terminated, the process returns to S1101.

  The image monitoring process is a process that operates separately from the embodiment described with reference to FIGS. That is, the image monitoring process can supply the update image generated by the update image generation unit 242 to the portable terminal 3 when there is no touch such as a tap on the touch panel 304 on which the key arrangement image is displayed. For example, in the character input process described with reference to FIGS. 7 to 10, the update image generation unit 242 estimates the next input character from the input character string and omits the first tap. Can be displayed. In one example, when the character string “Konichi” is input, the update image generation unit 242 estimates that the character “ha” will be input next, and the “ha” key to the “ho” key can be selected. An updated image developed in this way can be generated. In another example, when the character string "kyou" is inputted, updating the image generating unit 242, then the character "ha" estimates that are input, the string "Hello input content display unit 430 May be displayed. Further, when the update image generation unit 242 generates a key array image including an advertisement at a predetermined cycle, the key array image including the advertisement can be displayed on the touch panel 304 of the mobile terminal 3.

  Since the data input system 1 uses a software keyboard mounted on the personal computer 2, it is not necessary to install a dedicated software keyboard on the mobile terminal 3. Since there is no need to install a dedicated software keyboard on the mobile terminal 3, it is not necessary to develop a software keyboard for each OS of the mobile terminal, and cost can be reduced.

  In addition, since the data input system 1 includes the coordinate information conversion unit 230 that converts the coordinate information that is the coordinates of the web browser into an input event, the event conversion unit 240 is another software keyboard that generates an image corresponding to the input event. Can be substituted.

  Moreover, in the data input system 1, since the input key sequence is arranged at the same interval as the length of one side of the input key, the possibility that the upper limb disabled person 100 taps the input key is reduced. be able to. Moreover, in the data input system 1, since a character is input by carrying out two taps, the possibility that a character is erroneously input can be reduced. In addition, the update image displayed by the first tap is a pair of input keys that are arranged between the input key strings and separated from each other by the same length as the side of the input key as selectable input keys. Contains input keys. Since the input keys arranged so as to be separated from each other by the same length as the sides of the input keys are used as selectable input keys, the possibility of erroneous taps occurring at the time of the second tap can be reduced. .

  In the data input system 1, the key size change key 414 can be used to change the size so that the size can be reduced if the arrangement pitch of the plurality of input keys is maintained. The possibility of an erroneous tap by a disabled person can be further reduced.

  In the data input system 1, the arrangement direction of the input key row can be changed to either the horizontal direction or the vertical direction, and the arrangement of the input keys can be changed using the custom key 705. Depending on the preferred sequence can be selected.

  In the data input system 1, the area 440 in which the image setting unit 311 of the mobile terminal 3 displays an image includes the input content display unit 430, and the mouse pointer displayed on the information display unit 203 is all moved. By using it as an area to be used, the display area can be effectively used by moving the mouse pointer from any position.

  In the data input system 1, the mobile terminal 3 communicates with the personal computer 2 using HTTP via an installed web browser. If the personal computer 2 has a corresponding communication function, the short-distance terminal You may communicate via the communication part 302. FIG.

  In the data input system 1, the event conversion unit 240 is used, but another software keyboard that generates an image corresponding to the input event may be used.

  In the data input system 1, the intervals of the first input key row 421, the second input key row 422, and the third input key row 423 of the initial image 400 are the same length as the side length of the input key. You may make it longer than the length of the side of an input key.

  In the data input system 1, the image supply unit 222 compares the image previously supplied with the update image to determine whether to update the image. However, a part of the image supplied earlier and the update image It may be determined whether or not to update the image by comparing the corresponding part. For example, when the update image generation unit 242 has a function of estimating a character string to be input and displaying it on the input content display unit 430, it corresponds to the previously supplied image and the image of the input content display unit 430 of the update image. It may be determined whether or not to update the image by comparing the image data to be updated. In addition, when the update image generation unit 242 generates a key arrangement image including an advertisement at a predetermined cycle, by comparing image data corresponding to a portion where the previously supplied image and the advertisement of the update image are arranged. It may be determined whether to update the image.

DESCRIPTION OF SYMBOLS 1 Data input system 2 Personal computer 203 Information display part 221 Coordinate information acquisition part 222 Image supply part 230 Coordinate information conversion part (conversion part)
241 Character data converter (converter)
242 Update image generation unit 3 Mobile terminal 304 Touch panel 312 Coordinate information generation unit 313 Coordinate information supply unit

Claims (12)

A data input system having a portable terminal and an information processing apparatus communicating with the portable terminal,
The portable terminal is
A plurality of input key rows having a plurality of rectangular input keys arranged along a first direction and spaced apart from each other by a length equal to or longer than a side of the input key; A touch panel that displays a key layout image including a key layout of a software keyboard that can be changed to reduce the size of the keys if the key arrangement pitch is maintained .
A coordinate information generating unit that generates coordinate information indicating the touched position of the touch panel;
A coordinate information supply unit that supplies the coordinate information to the information processing apparatus,
The information processing apparatus includes:
A coordinate information acquisition unit for acquiring the coordinate information from the mobile terminal;
A conversion unit that converts the coordinate information into character data corresponding to the key arrangement image;
And an information display unit that displays characters indicated by the character data acquired from the conversion unit. An update image generation unit that generates an update image that is an image obtained by changing the key arrangement of the key arrangement image displayed on the touch panel from the coordinate information;
The data input system according to claim 1, further comprising an image supply unit that supplies the updated image to the mobile terminal. The information processing apparatus includes:
An image updating unit for determining whether to update an image displayed on the touch panel;
The data input system according to claim 2, wherein the image supply unit supplies the updated image to the mobile terminal when the image update unit determines to update an image displayed on the touch panel. The image update unit
The image supplied by the image supply unit is compared with the updated image,
The data input system according to claim 3, wherein when the image supplied by the image supply unit does not match the updated image, the image displayed on the touch panel is determined to be updated. The image update unit
Comparing a portion of the image previously supplied by the image supply unit with a corresponding portion of the updated image;
The data input system according to claim 3, wherein the image displayed on the touch panel is determined to be updated when the compared portions do not match. The update image includes a pair of input keys arranged between the plurality of input key rows and arranged to be separated from each other by a length equal to or longer than a side of the input key . The data input system according to any one of the above. The data input system according to claim 6 , wherein the plurality of input keys arranged in the first direction can be changed so as to be arranged along a second direction different from the first direction. The data input system according to claim 6 or 7 , wherein an area between the plurality of input key strings in the key arrangement image is an area used for moving a mouse pointer displayed on the information display unit. A plurality of input key rows having a plurality of rectangular input keys arranged along a first direction and spaced apart from each other by a length equal to or longer than a side of the input key; A coordinate having a touch panel that displays a key layout image including a key layout of a software keyboard that can be changed so as to reduce the size of the key if the key arrangement pitch is maintained, and indicating the touched position of the touch panel A coordinate information receiving unit that acquires the coordinate information from a mobile terminal that generates information;
A conversion unit that converts the coordinate information into character data corresponding to the key arrangement image;
An information display unit for displaying characters indicated by the character data acquired from the conversion unit;
An information processing apparatus comprising: A plurality of input key rows having a plurality of rectangular input keys arranged along a first direction and spaced apart from each other by a length equal to or longer than a side of the input key; A coordinate having a touch panel that displays a key layout image including a key layout of a software keyboard that can be changed so as to reduce the size of the key if the key arrangement pitch is maintained, and indicating the touched position of the touch panel Obtaining the coordinate information from a portable terminal that generates information;
Converting the coordinate information into character data corresponding to the key arrangement image;
Outputting the character data;
A computer program for causing a data processing unit to execute processing. The portable terminal has a plurality of square input keys arranged along the first direction on the touch panel, and a plurality of input key strings arranged so as to be separated from each other by a length equal to or longer than a side of the input key. A key arrangement image including a key arrangement of a software keyboard that can be changed to reduce the size of the key if the input key arrangement pitch is maintained .
The mobile terminal generates coordinate information indicating a touched position of the touch panel,
The portable terminal supplies the coordinate information to an information processing device,
The information processing apparatus converts the coordinate information into character data corresponding to the key arrangement image,
The information processing apparatus displays a character indicated by the character data on an information display unit.
An information processing method characterized by comprising: The portable terminal has a plurality of square input keys arranged along the first direction on the touch panel, and a plurality of input key strings arranged so as to be separated from each other by a length equal to or longer than a side of the input key. A key arrangement image including a key arrangement of a software keyboard that can be changed to reduce the size of the key if the input key arrangement pitch is maintained .
The mobile terminal generates first coordinate information indicating a first tapped position of the touch panel,
The portable terminal supplies the first coordinate information to an information processing device,
The information processing apparatus generates an update image including a key arrangement different from the key arrangement of the key arrangement image from the first coordinate information,
The information processing apparatus supplies the updated image to the mobile terminal,
The mobile terminal displays the updated image,
The mobile terminal generates second coordinate information indicating a second tapped position of the touch panel,
The portable terminal supplies the second coordinate information to the information processing apparatus;
The information processing apparatus converts the second coordinate information into character data corresponding to the updated image,
The information processing device displays a character indicated by the character data on an information display unit of the information processing device.
An information processing method characterized by comprising:

Images