JP2013219610A - Information processing apparatus, information processing method, and keyboard creation system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus that makes a computer recognize data input from a software keyboard, having a keyboard configuration corresponding to a state of use by a user, as if the data were input from an ordinary keyboard.SOLUTION: There is provided a programmable keyboard 1 including a transparent touch panel 2, a liquid crystal display 3 configuring a virtual keyboard together with the transparent touch panel 2 by displaying a keyboard array so that a user can view through the transparent touch panel 2, and a control section 5 which converts a user's input from the transparent touch panel 2 into a code and outputs the code.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a keyboard creation system for creating the software keyboard and the like applied to a software keyboard or the like that realizes a keyboard form according to a usage situation by a user.

  Conventionally, as seen on a keyboard for a personal computer (hereinafter referred to as “normal keyboard”), a character name or a function name is printed in advance on the top surface of the key top, and a code corresponding to the name is output. . They are mostly standardized, with some differences in key layout and number of keys. This does not change the key layout freely because of the degree of freedom of its original purpose of use, and uses alphanumeric characters and the minimum function keys and control keys.

  By the way, in a computer used only for a specific application, the data to be input is in a limited data format, and in order to input this data quickly and easily, a plurality of key input data is assigned to the keyboard interface as one key. A programmable keyboard that can be generated by pressing is used instead of the above-described normal keyboard or continuously connected to the normal keyboard.

  In recent years, so-called software keyboards, in which a programmable keyboard that realizes such a keyboard form in accordance with the use state by a user, is realized by software, have begun to spread widely.

  For example, Patent Document 1 discloses a software keyboard that can be customized by a user (changes such as character positions, alphabetical order, and special characters). The keyboard disclosed in Patent Document 1 displays, for example, an explorer key for direct access to the Internet and a telephone interface for use in the same way as a telephone for standard conversation in conjunction with a telephone headset. In addition, a telephone key is displayed that provides the possibility of connecting to a terminal that will newly establish a friend's telephone. In addition, with this keyboard, functions such as “copy”, “paste”, “cut”, “open”, “find”, etc. The mouse key for starting the mouse interface is also displayed by the same function as the three-button mouse.

  Patent Document 2 discloses an information processing apparatus that includes a display screen and a touch panel formed on the display screen. In the information processing apparatus disclosed in Patent Document 2, a keyboard is displayed on the display screen, and it is determined which part of the keyboard is pressed by the user, and it is determined that the corresponding part of the key has been selected. To do. In this information processing apparatus, a list of a plurality of software keyboards is displayed to enable selection by the user.

JP 2009-512047 A (published March 19, 2009) JP 6-131096 A (published on May 13, 1994)

  In order for a software keyboard that realizes a keyboard configuration according to the usage state by a user to be widely used in a computer or the like, it is necessary to realize an interface that can be connected to any computer. From this point of view, a data conversion process for sending data input from the software keyboard customized by the user to the computer as if input from the normal keyboard is essential.

  However, Patent Document 1 and Patent Document 2 described above do not describe or disclose any such data conversion processing.

  Further, Patent Document 1 and Patent Document 2 described above also disclose disclosure of a development environment in which a user can freely define a keyboard form, which is indispensable for realizing a form according to the use state by the user. It has not been done. For example, disclosure or suggestion of freely determining the overall pattern of the keyboard, selecting some or all of the keys on a normal keyboard, and giving them a name or key top pattern that is different from the normal keyboard It has not been. It also discloses how to freely decide the key layout, freely associate selected keys with normal keyboard keys (freely assign codes), and freely set a mouse area that has the same function as the mouse. There is no suggestion. Furthermore, the disclosure also suggests that by creating a plurality of keyboard forms freely set by the user in this way and attaching an identification code to each keyboard form, the user can freely select among them. It has not been done.

  The present invention has been made to solve the above-described problem, and allows a computer to recognize data input from a software keyboard that realizes a keyboard form according to a user's usage state as if it were input from a normal keyboard. It is an object to provide an information processing apparatus, an information processing method, and a keyboard creation system.

  Another object of the present invention is to use a standard interface such as USB-HID as an interface to a computer and make the standard driver available on the computer side, thereby separately preparing or developing a driver on the computer side. It is an object to provide an information processing apparatus, an information processing method, and a keyboard creation system that can eliminate this need.

  In order to achieve the above object, an information processing apparatus according to the present invention displays a transparent touch panel and a keyboard layout so that a user can view through the transparent touch panel, and is disposed so as to face the transparent touch panel. A keyboard arrangement display member that constitutes a virtual keyboard together with the transparent touch panel, and an input by the user using the virtual keyboard key from the transparent touch panel is converted into a code set for the key. And the keyboard arrangement and code are defined in a development environment in which the user can freely define the keyboard arrangement and code.

  An information processing method according to the present invention includes a transparent touch panel and a keyboard that displays a keyboard layout so that a user can view through the transparent touch panel, and is disposed so as to face the transparent touch panel, together with the transparent touch panel. An information processing method for an information processing apparatus comprising a keyboard array display member that constitutes a key, wherein a virtual input from the transparent touch panel by the user using the keys of the keyboard array is set to the key The keyboard arrangement and code are defined in a development environment in which the user can freely define the keyboard arrangement and code.

  In the above configuration, the keyboard layout displayed by the keyboard layout display member is visually recognized by the user through the transparent touch panel. The transparent touch panel and the keyboard arrangement display member constitute a virtual keyboard, and the user can input using the keyboard arrangement by a touch operation of the transparent touch panel.

  According to the above configuration, by providing the control means (control process) for converting the input using the key of the keyboard layout into the code set to the key and outputting it, the keyboard layout freely defined by the user Even in this case, the input using the keys of the keyboard layout can be converted into a code, for example, a USB-HID interface code and output.

  By converting the data into a known code such as a USB-HID interface and outputting it, it appears to the computer as if data were normally input from a keyboard or mouse.

  For this reason, for example, the user can freely decide the overall pattern of the keyboard, select some or all of the normal keyboard keys, and give them a name or key top pattern different from the normal keyboard. Can do. In addition, it is possible to freely determine a key layout, freely associate a selected key with a normal keyboard key (assign a code freely), and freely set a mouse area having the same function as a mouse.

  Therefore, it is possible to make the computer recognize the data input from the software keyboard that realizes the keyboard form according to the usage status by the user as if it were input from the normal keyboard.

  The information processing apparatus further includes a nonvolatile memory unit that stores the code, and each address in the address space of the nonvolatile memory unit associated with the coordinates of each position of the transparent touch panel is associated with each position. Preferably, a code to be converted from the input is stored.

  According to the above configuration, since the code to be converted can be acquired from the coordinates of each position of the transparent touch panel, the efficiency of code conversion can be improved.

  In the information processing apparatus, the control unit is stored in a determination unit that determines the coordinates of the position of the input by the user on the transparent touch panel, and an address associated with the coordinates based on the determination result of the determination unit. It is preferable to have acquisition means for acquiring the code from the nonvolatile memory unit.

  In the information processing apparatus, the keyboard array display member is preferably any of a liquid crystal display, an organic electroluminescence display, a plasma display, a field emission display, and electronic paper.

  In the information processing apparatus, the keyboard arrangement display member is preferably a printed matter on which the keyboard arrangement is printed.

  A keyboard creation system according to the present invention includes the information processing apparatus and a computer for setting keyboard arrangement information that is information related to the keyboard arrangement in the information processing apparatus.

  In the keyboard creation system, in the development environment using the computer, it is preferable that the entire keyboard pattern included in the keyboard layout information can be freely defined.

  In the keyboard creation system, in the development environment, it is preferable that the keys included in the keyboard layout information can be freely defined as a part or all of the normal keyboard keys.

  In the keyboard creation system, in the development environment, it is preferable that a key name and a key top pattern of the key included in the keyboard layout information can be freely defined.

  In the keyboard creation system, it is preferable that a layout of keys included in the keyboard layout information can be freely defined in the development environment.

  In the keyboard creation system, in the development environment, it is preferable that codes set to keys included in the keyboard layout information can be freely defined.

  In the keyboard creation system, it is preferable that the mouse area included in the keyboard layout information can be freely defined in the development environment.

  In the keyboard creation system, it is preferable that a plurality of the keyboard layout information is created in the development environment, and a unique identification code is attached to each keyboard layout information.

  Preferably, the information processing apparatus further includes a selection unit that selects any one of the plurality of keyboard arrangement information using the identification code.

  The information processing apparatus may be realized by a CPU or MPU. In this case, an information processing apparatus that realizes the information processing by the CPU or MPU by operating the CPU or MPU as the respective units. A control program and a recording medium on which the control program is recorded also fall within the scope of the present invention.

  As described above, the information processing apparatus according to the present invention displays the keyboard arrangement so that the user can visually recognize the transparent touch panel through the transparent touch panel, and is disposed so as to face the transparent touch panel. A keyboard layout display member that constitutes a virtual keyboard together with the touch panel, and input by the user using the virtual keyboard key from the transparent touch panel is converted into a code set for the key and output. The keyboard arrangement and code are defined in a development environment in which the user can freely define the keyboard arrangement and code.

  As described above, the information processing method of the present invention displays a transparent touch panel and a keyboard layout so that a user can view through the transparent touch panel, and is disposed so as to face the transparent touch panel and is transparent. An information processing method for an information processing apparatus including a keyboard arrangement display member that constitutes a virtual keyboard together with a touch panel, wherein the user inputs virtual keys from the transparent touch panel using the keyboard arrangement keys. The keyboard layout and code are defined in a development environment in which the user can freely define the keyboard layout and code.

  Therefore, there is an effect that the computer can recognize the data input from the software keyboard that realizes the keyboard form according to the use state by the user as if it was input from the normal keyboard.

  Further, by adopting a standard interface such as USB-HID as an interface to the computer and making the standard driver available on the computer side, it is unnecessary to prepare or develop a driver on the computer side separately. There is an effect.

It is a block diagram which shows schematic structure of the programmable keyboard which concerns on one embodiment of this invention. It is a block diagram which shows the functional schematic structure of the control part in the said programmable keyboard. It is a block diagram which shows the hardware schematic structure of the control part in the said programmable keyboard. It is a flowchart which shows the process routine of the control part in the said programmable keyboard.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. In addition, the following embodiment is an example which actualized this invention, Comprising: The thing of the character which limits the technical scope of this invention is not.

(Embodiment 1)
FIG. 1 is a block diagram showing a schematic configuration of a programmable keyboard 1 to which the information processing apparatus according to this embodiment is applied. As shown in FIG. 1, the programmable keyboard 1 includes a transparent touch panel 2, a liquid crystal display (keyboard array display member) 3, a liquid crystal display driving unit 4, a control unit (control means) 5, and a nonvolatile memory unit 6. A keyboard type selection unit (selection means) 7 and a keyboard type notification unit 8.

  The programmable keyboard 1 is, for example, a software keyboard displayed on a display panel in order to input data input by a user to the microcomputer using a display panel using a touch panel in an electronic device equipped with a microcomputer. It is comprised as.

  As will be described in detail below, the programmable keyboard 1 can send data input by the user to the microcomputer using any of the electronic devices as if it were normally input from the keyboard. For example, even when a plurality of electronic devices equipped with microcomputers that are used only for different applications are prepared, the programmable keyboard 1 can be customized for each electronic device according to the usage status by the user.

  As the transparent touch panel 2, various types of touch panels such as a so-called resistance film (pressure-sensitive) method and a capacitance method can be used. For example, touch panels using a capacitive method are widely used. In a capacitive touch panel, a contact position is detected by detecting a change in capacitance when a finger or an input pen is brought into contact with the display screen. For this reason, the contact position can be detected by a simple operation. Specifically, the touch surface that receives the contact of the indicator (indicating the screen position of the transparent touch panel 2, for example, the user's finger), and the contact / non-contact (approach / non-contact) between the indicator and the touch surface. And a touch sensor for detecting the contact (approach) position. The touch sensor may be realized by any sensor as long as it can detect contact / non-contact between the indicator and the touch surface. For example, it is realized by a pressure sensor, a capacitance sensor, an optical sensor, or the like.

  For example, when the transparent touch panel 2 is realized by a projected capacitive touch panel, the touch sensor forms a matrix-like transparent electrode pattern made of ITO (Indium Tin Oxide) or the like on a transparent substrate such as glass or plastic. Will be. When the indicator (user's finger) comes into contact with or approaches the touch sensor, the electrostatic capacity of a plurality of transparent electrode patterns in the vicinity changes. Therefore, the control part 5 can detect the position where the said indicator contacted or approached by detecting the change of the electric current or voltage of the said transparent electrode pattern.

  The liquid crystal display 3 displays a keyboard layout of the programmable keyboard 1 customized by the user, or displays a mouse area for starting a mouse interface with the same function as a conventional three-button mouse. By tracing this mouse area on the transparent touch panel 2 with the above-mentioned indicator, a mouse function of drawing a line or moving a cursor can be realized.

  Of course, instead of the liquid crystal display 3, an organic electroluminescence display having a display function equivalent to that of the liquid crystal display 3, a plasma display, or a field emission display display panel may be used. Alternatively, a keyboard layout may be displayed on the electronic paper instead of such a display panel. In this case, since power is consumed only for rewriting the keyboard, the power consumption of the programmable keyboard 1 can be reduced.

  The liquid crystal display 3 is arranged so that its display surface overlaps the touch surface of the transparent touch panel 2. The user can view the display surface of the liquid crystal display 3, that is, the keyboard displayed on the liquid crystal display 3 through the transparent touch panel 2.

  The display surface of the liquid crystal display 3 and the touch surface of the transparent touch panel 2 have the same coordinates. For example, if the user touches the touch surface of the transparent touch panel 2, the coordinates of the touch position are the same. A key on the display surface of the liquid crystal display 3 is pressed. That is, the transparent touch panel 2 and the liquid crystal display 3 constitute a virtual software keyboard (virtual keyboard).

  The liquid crystal display drive unit 4 is a drive circuit that drives the display operation of the liquid crystal display 3 based on a control signal from the control unit 5.

  The control unit 5 controls the operation of the entire programmable keyboard 1. The functional configuration of the control unit 5 is shown in FIG. 2, and details thereof will be described later. As illustrated in FIG. 3, the control unit 5 serving as an information processing apparatus stores, for example, a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52 that stores programs, and programs and data when various processes are executed. A RAM (Random Access Memory) 53, an input / output interface 54, and a bus 55 for connecting them can be used. The CPU 51 loads a program stored in the ROM 52 and a program input via the input / output interface 54 to the RAM 53 and executes various processes.

  As the nonvolatile memory unit 6, for example, an EEPROM, a flash memory, or an HDD can be used. In addition, the control part 5 can be provided with the interface for connecting the non-volatile memory part 6 to self. For example, a socket for inserting an external recording medium (memory card or the like), an HDMI (High Definition Multimedia Interface) terminal, a USB (Universal Serial Bus) terminal, or the like. In this case, the control unit 5 can transmit / receive data to / from the nonvolatile memory unit 6 through such an interface.

  The non-volatile memory unit 6 stores keyboard layout information related to the keyboard layout displayed on the liquid crystal display 3. This keyboard layout information is set, for example, for the overall size / shape of the keyboard, the number of keys, the color / pattern / shape / size of the key top, the color / pattern of the portion excluding the keyboard keys, and each key. Each code is included. Further, if the above-described mouse area is displayed on the liquid crystal display 3, the keyboard layout information includes the range of the mouse area (the operating range of the mouse) and the color / shape / size of the cursor.

  Here, each position of the keyboard, each key of the keyboard, and each mouse area represents each position on the touch surface of the transparent touch panel 2 and the display surface of the liquid crystal display 3. That is, coordinates on the touch surface of the transparent touch panel 2 and the display surface of the liquid crystal display 3 are set in the keyboard, each key of the keyboard, and the mouse area, respectively. As described above, the coordinates on the touch surface of the transparent touch panel 2 and the display surface of the liquid crystal display 3 coincide with each other. The keyboard layout information described above includes each coordinate set in this way.

  For example, when the programmable keyboard 1 is combined with a computer and operates as a keyboard of the computer, if the non-volatile memory unit 6 is not provided, the above keyboard arrangement information is transferred from the computer side to the programmable keyboard 1 every time power is input. I need to send it. In order to avoid such trouble, the keyboard layout information is stored in the nonvolatile memory unit 6 that retains the memory even when the power is turned off.

  When the keyboard type selection unit 7 stores a plurality of keyboard layout information in the nonvolatile memory unit 6, that is, when the programmable keyboard 1 can realize a plurality of keyboard layouts, which keyboard layout should be realized? For the user to select. The keyboard type selection unit 7 can use, for example, a known dip switch. In this case, the number of switches is determined according to the number of keyboard layout information stored in the nonvolatile memory unit 6.

  When a plurality of keyboard layout information is stored in the nonvolatile memory section 6, that is, when the programmable keyboard 1 can realize a plurality of keyboard layouts, the keyboard type notification section 8 is connected to the liquid crystal display 3. This is a so-called indicator for notifying the user of whether it is displayed. As such an indicator, for example, a plurality of LEDs (Light Emitting Diodes) having different colors can be used.

  The programmable keyboard 1 executes a data conversion process for sending data input from a keyboard customized by the user to a computer as if it were input from a normal keyboard.

  The “data conversion process” is realized by the control unit 5 of the programmable keyboard 1. As shown in FIG. 2, the control unit 5 includes a touch detection unit 10, a keyboard layout generation unit 11, a buffer memory 12, a touch position determination unit (determination unit) 13, a mouse operation generation unit 14, an address A generation unit (acquisition unit) 15 and a code conversion processing unit (acquisition unit) 16 are provided. Each component of the control unit 5 can be configured in hardware by a dedicated LSI or the like, but can also be realized in software by the CPU 51 shown in FIG. 3 executing a program. Details of each component of the control unit 5 will be described later.

  First, the “data conversion process” will be described in detail below.

  In the present embodiment, a development environment (keyboard creation system) for the programmable keyboard 1 is prepared. In this development environment, the user must include the entire keyboard size / shape, the number of keys, the key top color / pattern / shape / size, and the color of the part excluding the keyboard keys, which will be included in the above keyboard layout information.・ Patterns can be set arbitrarily (defined freely).

  Specifically, for example, when using a tool that can be drawn (general purpose or commercially available) on a computer or the like, the key portion is given various sizes (position information and key codes). (Rectangle, circle, pentagon, etc.) key template. The size of the key template is variable when it is placed. When the placement is determined, the identification code (ID) of the key, the size and size of the boundary, and the position in the keyboard are given as information. It is done.

  Furthermore, the user can arbitrarily set (freely define) codes assigned to the keys of the keyboard. As a code assigned to each key, for example, each code of a known USB-HID interface can be used. In this case, if the computer has a USB port, the programmable keyboard 1 is recognized as a normal keyboard or a USB mouse when viewed from the computer by using, for example, a Windows (registered trademark) standard driver. In other words, data input from a keyboard customized by the user can be sent to the computer as if it were input from a normal keyboard or USB mouse. In addition to the USB-HID interface codes, for example, ASCII code may be used.

  In the development environment described above, not only one keyboard layout that can be customized by the user but also a plurality of settings (definitions) can be made. The user creates such keyboard layout information using a computer (development computer) constituting the development environment. Then, the keyboard layout information created by the user is sent from the development computer to the control unit 5 of the programmable keyboard 1. For example, the key code, the size, and the position information are sent to the control unit 5 through a suitable interface such as USB (in a table).

  The control unit 5 stores the keyboard layout information sent from the development computer in this manner in the nonvolatile memory unit 6. Here, the location in the address space of the nonvolatile memory unit 6 where the coordinates of each key of the keyboard included in the keyboard layout information and the information of each key (particularly, the code assigned to each key) is stored. The address to be specified is associated. By such association, a code assigned to the key is extracted based on the coordinates of the key. That is, by storing the keyboard layout information in the nonvolatile memory unit 6 in advance by such association, any keyboard layout customized by the user can be assigned to each key of the keyboard layout. It is possible to take out the generated code.

  As described above, in this embodiment, a development environment is provided that allows the user to freely define the keyboard form, which is indispensable for realizing the form according to the usage state by the user. For example, it is possible to freely determine the overall pattern of the keyboard, select some or all of the keys of the normal keyboard, and give them names or key top patterns different from those of the normal keyboard. In addition, you can freely decide the key layout, freely associate selected keys with normal keyboard keys (assign codes freely), and freely set (define) a mouse area that has the same function as the mouse. Can do. Further, by creating a plurality of keyboard forms freely set by the user in this way and uniquely assigning an identification code to each keyboard form, the user can freely select among them.

  The “data conversion process” is realized by such a feature of the present invention.

  Next, a functional schematic configuration of the control unit 5 will be described with reference to FIG.

  The touch detection unit 10 processes a signal output from the touch surface of the transparent touch panel 2 and detects a user's touch panel operation. The detection result includes at least contact coordinate information indicating the coordinate position of the contact position of the indicator (for example, a finger). Thereby, each part of the control part 5 can obtain the locus | trajectory of the movement of the said indicator from the said contact coordinate information.

  The touch detection unit 10 detects, for example, what kind of touch panel operation is the contact operation performed on the touch surface of the transparent touch panel 2. For example, the touch detection unit 10 can determine touch panel operations such as “tap”, “flick”, “pinch”, “drag”, “enclose”, and the like. As an algorithm for detecting a touch panel operation, a known technique can be appropriately adopted. The touch detection unit 10 instructs each unit of the control unit 5 to execute processing corresponding to the touch panel operation according to the detection result.

  The keyboard layout generation unit 11 generates a keyboard layout image to be displayed on the liquid crystal display 3. The keyboard layout generation unit 11 generates the above keyboard layout image using the keyboard layout information selected by the user among the one or more keyboard layout information stored in the nonvolatile memory unit 6. For example, when the programmable keyboard 1 is turned on, the user selects keyboard layout information using the keyboard type selection unit 7 of the programmable keyboard 1. If the programmable keyboard 1 is already in operation, it is selected from a touch panel operation using the transparent touch panel 2 or an application program executed on a computer to which the programmable keyboard 1 is connected.

  When the keyboard layout image is generated, the keyboard layout generator 11 outputs the keyboard layout image to the liquid crystal display driver 4 and the buffer memory 12. The liquid crystal display drive unit 4 drives the liquid crystal display 3 based on the keyboard arrangement image sent from the keyboard arrangement generation unit 11 to display the keyboard on the liquid crystal display 3.

  The buffer memory 12 temporarily stores the keyboard layout image generated by the keyboard layout generation unit 11.

  The touch position determination unit 13 acquires contact coordinate information from the touch detection unit 10 and a keyboard layout image from the buffer memory 12. The touch position determination unit 13 determines which position on the keyboard array image the user touch position on the touch surface of the transparent touch panel 2 (and the display surface of the liquid crystal display 3) is.

  Here, the keyboard layout image of the buffer memory 12 is displayed on the display surface of the liquid crystal display 3 as described above. On the other hand, the contact coordinate information from the touch detection unit 10 indicates coordinates on the touch surface of the transparent touch panel 2. Since the coordinates of the touch surface of the transparent touch panel 2 and the display surface of the liquid crystal display 3 match, each position on the keyboard arrangement image displayed on the display surface of the liquid crystal display 3 and the touch surface of the transparent touch panel 2 These positions can be associated with each other.

  The touch position determination unit 13 determines which position on the keyboard layout image the user's touch position on the touch surface of the transparent touch panel 2 is by using such association.

  The touch position determination unit 13 further determines whether the touch position of the user is on the keyboard key or the mouse area in the keyboard layout image. The touch position determination unit 13 performs such determination by using the above-described association.

  The touch position determination unit 13 performs the above-described touch position determination every time the touch detection unit 10 detects a touch panel operation of the user.

  The touch position determination unit 13 outputs the result of the touch position determination described above and the contact coordinate information received from the touch detection unit 10 to the mouse operation generation unit 14 and the address generation unit 15, respectively.

  When the touch position determination unit 13 determines that the user's touch position is on the mouse area in the keyboard layout image, the mouse operation generation unit 14 uses the contact information from the touch detection unit 10 to perform the mouse operation. Generate movement information to represent. This movement information is, for example, movement information representing the operation of the USB mouse. By using such movement information, it appears to the computer as if movement information from a known USB mouse has been input.

  When the touch position determination unit 13 determines that the user's touch position is on the keyboard in the keyboard layout image, the address generation unit 15 uses the contact information from the touch detection unit 10 to determine whether the user's touch position is on the keyboard. Identify the key. As described above, the coordinates of each key of the keyboard and the address in the address space of the nonvolatile memory unit 6 are associated with each other. The address generation unit 15 uses this association to generate an address in the address space of the nonvolatile memory unit 6 in which the code assigned to the key on the touch position of the user is stored. A specific example of this association will be described later.

  The code conversion processing unit 16 uses the address generated by the address generation unit 15 to extract the code stored at the address from the nonvolatile memory unit 6. This code is, for example, a USB-HID interface code. By using such a code, it will appear to the computer as if data were normally input from the keyboard.

  In the above configuration, the processing routine of the control unit 5 in the programmable keyboard 1 will be described based on the flowchart of FIG.

  In FIG. 4, first, the user touches the coordinate position (px, py) on the touch surface of the transparent touch panel 2 (S101). The coordinate position (px, py) uses a coordinate system having a reference point (0, 0) on the touch surface of the transparent touch panel 2 (normally, the upper left of the touch surface is the reference point). This coordinate position, that is, the touch position is detected by the touch detection unit 10.

  Thereafter, when the touch detection unit 10 detects a touch on the touch surface of the transparent touch panel 2 by the user (S102), the touch position determination unit 13 detects the touch coordinate information from the touch detection unit 10 and the keyboard arrangement from the buffer memory 12. Using the image, it is determined whether the touch position is on the keyboard key in the keyboard layout image or the mouse area (S103).

  If it is on the mouse area (YES in S103), the mouse motion generation unit 14 moves the mouse from the coordinate position (px, py) to the coordinate position (here, (x, y)) that is the touch position. Movement information representing this is generated (S104). This movement information is output to the computer using the input / output interface 54 shown in FIG.

  From the computer, it appears as if the mouse has moved from the coordinate position (px, py) to the coordinate position (x, y) (S105).

  On the other hand, if it is not on the mouse area in step S103 (NO in S103), the address generation unit 15 specifies a key on the touch position of the user using the position coordinates. For example, the address generation unit 15 generates an address in the address space of the nonvolatile memory unit 6 in which codes assigned to keys on the touch position of the user are stored as follows.

  An address in the address space of the nonvolatile memory unit 6 is generated by the following expression.

Address = (a * y + x) * b + c
Here, a is the resolution in the x direction of the touch surface of the transparent touch panel 2, and b is the byte length (byte length) of the code assigned to each key (for example, 2 bytes if b = 2). C is an offset address indicating how far each code is from the starting point in the address space of the nonvolatile memory unit 6.

  The address generation unit 15 generates an address in which a code is stored by being assigned to the key at the coordinate position (x, y) from the coordinate position (x, y) that is the touch position, using the above formula. .

  The code conversion processing unit 16 searches the address space of the nonvolatile memory unit 6 using the address generated by the address generation unit 15, and the coordinate position (x, y) is also in an invalid area, that is, the mouse area. If it is not on any key (NO in S107), the code assigned to the key at the coordinate position (x, y) is acquired (S108).

  The extracted code is output to the computer using the input / output interface 54 shown in FIG. 3 (S109).

  As described above, according to the programmable keyboard 1, it is possible to execute data conversion processing for sending data input from a keyboard customized by the user to a computer as if it were input from a normal keyboard.

(Embodiment 2)
In the first embodiment, the keyboard layout is displayed using the liquid crystal display 3. On the other hand, in the second embodiment of the present invention, a printed matter on which a keyboard layout is printed is used in place of the liquid crystal display 3 of the first embodiment. Configurations other than those described in the present embodiment are the same as those in the first embodiment. For convenience of explanation, members having the same functions as those shown in the drawings of Embodiment 1 are given the same reference numerals, and explanation thereof is omitted.

  In the programmable keyboard according to the present embodiment, the keyboard layout is printed on the paper. This printing process is executed, for example, by the printing function of the development computer described in detail in the first embodiment.

  In the first embodiment described above, the user creates keyboard layout information using the development computer and sends the keyboard layout information from the development computer to the control unit 5 of the programmable keyboard 1. In contrast, in the programmable keyboard according to the present embodiment, the created keyboard layout information is sent from the development computer to the control unit of the programmable keyboard according to the present embodiment, and using the keyboard layout information, Print keyboard layout on paper.

  As in the first embodiment, the printed surface of the printed material on which the keyboard layout is printed and the touch surface of the transparent touch panel 2 have the same coordinates. For example, the user touches the touch surface of the transparent touch panel 2. Then, the key on the printing surface of the printed matter at the same coordinate as that of the touch position is pressed. That is, the transparent touch panel 2 and the printed material constitute a virtual software keyboard.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  Finally, the control unit 5 of the programmable keyboard 1 may be configured by hardware logic, or may be realized by software using a CPU as follows.

  That is, the control unit 5 includes a central processing unit (CPU) that executes instructions of a control program for realizing each function, a read only memory (ROM) that stores the program, a random access memory (RAM) that expands the program, A storage device (recording medium) such as a memory for storing the program and various data is provided. An object of the present invention is a recording medium in which a program code (execution format program, intermediate code program, source program) of a control program of the control unit 5 which is software for realizing the above-described functions is recorded so as to be readable by a CPU or MPU. Can also be achieved by reading the program code recorded on the recording medium and executing it by the CPU or MPU.

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and a compact disk-ROM / MO / MD / digital video disk / compact disk-R. A disk system including an optical disk, a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM can be used.

  Further, the control unit 5 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used.

  The present invention can be applied to an information processing apparatus, an information processing method, and a keyboard creation system for creating the software keyboard and the like, which are applied to a software keyboard or the like that realizes a keyboard form according to a usage situation by a user.

DESCRIPTION OF SYMBOLS 1 Programmable keyboard 2 Transparent touch panel 3 Liquid crystal display (keyboard arrangement display member)
4 Liquid crystal display drive unit 5 Control unit (control means)
6 Nonvolatile memory section 7 Keyboard type selection section (selection means)
8 Keyboard type notification unit 10 Touch detection unit 11 Keyboard layout generation unit 12 Buffer memory 13 Touch position determination unit (determination means)
14 mouse motion generation unit 15 address generation unit (acquisition means)
16 Code conversion processing unit (acquisition means)
51 CPU
52 ROM
53 RAM
54 I / O interface 55 Bus

Claims (15)

A transparent touch panel,
A keyboard arrangement display member that displays a keyboard arrangement so that a user can view through the transparent touch panel, and that is arranged to face the transparent touch panel and constitutes a virtual keyboard together with the transparent touch panel;
Control means for converting an input from the transparent touch panel by the user using a virtual key of the keyboard arrangement into a code set to the key and outputting the code;
The information processing apparatus according to claim 1, wherein the keyboard layout and code are defined in a development environment in which the user can freely define the keyboard layout and code. A nonvolatile memory unit for storing the code;
2. The code to be converted from the input to each position is stored in each address in the address space of the nonvolatile memory unit associated with the coordinates of each position of the transparent touch panel. The information processing apparatus described in 1. The control means includes
Determining means for determining the coordinates of the position of the input by the user on the transparent touch panel;
The information processing apparatus according to claim 2, further comprising: an acquisition unit configured to acquire, from the nonvolatile memory unit, a code stored at an address associated with the coordinates based on a determination result of the determination unit. .   The information processing apparatus according to claim 1, wherein the keyboard array display member is any one of a liquid crystal display, an organic electroluminescence display, a plasma display, a field emission display, and electronic paper. .   The information processing apparatus according to claim 1, wherein the keyboard arrangement display member is a printed matter on which the keyboard arrangement is printed. The information processing apparatus according to any one of claims 1 to 5,
A keyboard creation system comprising: a computer for setting keyboard layout information, which is information relating to the keyboard layout and codes, to the information processing apparatus.   The keyboard creation system according to claim 6, wherein in a development environment using the computer, a pattern of the entire keyboard included in the keyboard layout information can be freely defined.   8. The keyboard creation system according to claim 6, wherein in the development environment, keys included in the keyboard layout information can be freely defined as part or all of normal keyboard keys.   9. The keyboard creation system according to claim 6, wherein in the development environment, a key name and a key top pattern of the key included in the keyboard layout information can be freely defined. .   The keyboard creation system according to any one of claims 6 to 9, wherein in the development environment, a layout of keys included in the keyboard layout information can be freely defined.   The keyboard creation system according to any one of claims 6 to 10, wherein in the development environment, codes set to keys included in the keyboard layout information can be freely defined.   The keyboard creation system according to any one of claims 6 to 11, wherein in the development environment, an area for arranging a mouse area included in the keyboard layout information can be freely defined.   The keyboard creation system according to any one of claims 6 to 12, wherein in the development environment, a plurality of the keyboard layout information is created, and a unique identification code is attached to each keyboard layout information.   14. The keyboard creation system according to claim 13, wherein the information processing apparatus further includes a selection unit that selects any of the plurality of keyboard arrangement information using the identification code. A transparent touch panel and a keyboard layout display member that displays a keyboard layout so that a user can view through the transparent touch panel and that is arranged to face the transparent touch panel and constitutes a virtual keyboard together with the transparent touch panel. An information processing method for an information processing apparatus comprising:
Including the step of converting the virtual input from the transparent touch panel by the user using the key of the keyboard arrangement into a code set in the key, and outputting the code.
An information processing method, wherein the keyboard layout and code are defined in a development environment in which the user can freely define the keyboard layout and code.

Images