JP2843077B2 - Information processing device using both keyboard and position input device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Summary] The present invention relates to an information processing apparatus using both a keyboard and a position input device. Conventionally, a mouse is used to maintain consistency between input operation using a position input device such as a mouse and key operation of a keyboard. Assigning arbitrary processing functions to keys on the keyboard with the aim of solving the problem that the advantages of keyboard input were not utilized and various MMIs could not be realized because key operations were absorbed in the operation , Data related to the function corresponding to the key code of the key,
Means for registering display data for the function and coordinate data of the display data, means for displaying the display data as a graphic pattern based on the registered data,
Means for confirming a key operation specified by display data on the display screen or a position input by a mouse and executing a processing function corresponding to the key code.

[Industrial Application Field] The present invention provides a keyboard and a position input device (for example, a mouse (Mouse)) operated by moving on a display screen.
Regarding the information processing device used as an input device, in particular, the advantage of keyboard input and the advantage of mouse input are used together without losing each other, and a keyboard and position input device that realize various MMI (man-machine interface) are used together. The present invention relates to an information processing device.

[Prior Art] In a conventional information processing apparatus, when a keyboard and a position input device are used together, for example, when a mouse is used as the position input device, a method of absorbing a key operation is included in the contents of the mouse operation. Often have been.

That is, as shown in the conventional key input and mouse input combined processing flow of FIG. 12, a mouse movement operation and a cursor movement key operation, and a left click operation and a return key pressing operation in selecting a displayed icon. The consistency of the operation is maintained regardless of the key input or the mouse input.

[Problem to be Solved by the Invention] However, the original meaning of the key input is to directly input the processing content corresponding to the icon selection by the mouse input from the key, and substitute the exact same operation as the mouse input operation. Not that.

In other words, mouse input has processing contents that make use of the characteristics of the mouse, and key input has processing contents that make use of the characteristics of the keyboard.
It is desirable that both of these can be used properly.

However, until now, there has been no attempt to use a common technique so that the above-described processing can be selected by using both key input and mouse input.

The present invention solves the above-mentioned problems, and for example, MMs corresponding to various users with different proficiency levels regarding computers in computer-assisted learning / education (CAL / CAI) and the like.
As an effective method for realizing I, an object is to provide an information processing apparatus using both a keyboard and a position input device that combine the advantage of key input and the advantage of mouse input without damaging each other.

[Means for Solving the Problems] According to the present invention, the above-mentioned object is achieved by the means described in the claims.

That is, the present invention relates to an information processing apparatus in which a keyboard and a position input device operated by moving on a display screen are used as input devices, wherein an arbitrary processing function is assigned to a predetermined key on the keyboard, In association with the code, the data relating to the processing function, the display data defining the content of the processing function and the display method of the key to be operated on the display screen, and the position of the display data on the display screen are determined. Means for registering coordinate data that is an input designation range by the position input device, and, during input processing, display data about a designated processing function based on the registered data, and display data designated by the coordinate data. Means for displaying a graphic pattern at a position on the screen, operation of a key specified by display data on the display screen, or input of a position. This is an information processing apparatus using both a keyboard and a position input device provided with means for confirming a position input within an input designated range by an input device and executing a processing function corresponding to a designated key code.

[Operation] In the information processing apparatus using both the keyboard and the position input device of the present invention, the device user selects an arbitrary key on the keyboard in advance and assigns an arbitrary processing function to the key. The processing functions include, for example, statements, programs, OS commands, and the like.

Then, the following data is registered in a file or the like corresponding to the key code of the selected key.

(B) Data related to processing functions.

(B) Data that determines the display method of the processing function on the display screen, for example, data that specifies the content of the processing function and the key to be operated.

(C) Coordinate data for determining the display position of the display data on the display screen, and the coordinate data is also data for determining the input designation range by the position input device.

In the case where the input instruction is displayed on the display screen based on the data registered in advance, the content of the processing function and the designation of the key to be operated when instructing the execution of the processing function are displayed. Icon (pictogram) when the display position of the display data is a position input device such as a mouse
Should be equivalent to

Therefore, the user can press a key designated by the display, select an icon with a mouse, or issue an instruction to execute a necessary processing function according to his / her preference.

Accordingly, the user can execute various and effective MMIs according to his / her preference by registering data such as processing functions in advance in association with the key codes.

[Embodiment] An embodiment of the present invention will be described below. FIG. 1 is a diagram showing a basic configuration of an embodiment of the present invention.
10 is a function data file, 11 is a display data file, 12
Is a coordinate data file, 13 is a graphic pattern data file, 14 is an arbitrary statement group, 15 is an arbitrary program group, 16 is an arbitrary OS command group, 20 is a key and mouse combined control unit, 21 is an initial setting processing unit , 22 is a display data processing unit, 23 is an input processing unit, 30 is an input device, 31 is a keyboard, 32 is a mouse, and 40 is a display device (display).

In the function data file 10, functions (statements / programs / OS commands) corresponding to the respective key codes are stored in a predetermined data format in advance.

In the display data file 11, information on character string data or graphic pattern data as display data corresponding to each key code is stored in advance in a predetermined data format.

In the coordinate data file 12, information on a display coordinate position of display data corresponding to each key code is stored in a predetermined data format in advance.

The initial setting processing unit 21 performs data setting by reading each data from the function data file 10, the display data file 11, and the coordinate data file 11.

The display data processing unit 22 reads graphic pattern data as display data corresponding to each key code from the graphic pattern data file 13 and saves the graphic pattern data on a memory. The data is converted into pattern data and saved on the memory in the same manner.

The input processing unit 23 displays, on the display device 40, graphic pattern data saved on the memory as display data corresponding to each key code, and
The processing for calling and executing the statement 14, the program 15, or the OS command 16 assigned to the designated key code from the keyboard 31 or the mouse 32 of the input device 30 is performed.

FIG. 2 is a diagram showing an execution screen according to the embodiment of the present invention, showing specific display data and an example of a method of designating the display data.

 Hereinafter, FIG. 2 will be described.

(1) First, on the display screen 41, a frame indicated by a broken line
41a and numerical values indicated by “0” to “1” in each framework are displayed.

In the present invention, the numerical values in the frames indicate the types of keys on the keyboard to be pressed, and each frame is an icon (pictogram).

Therefore, when the numeric key “1” on the keyboard is pressed in the state of the display screen 41 or the mouse cursor is moved into the frame of the numerical value “1” and the position is input by left-clicking, the state of the display screen 42 is changed. Transition.

(2) The display screen 43 shows display data when designating the selection of the “up / down” operation of the graphic pen in the case of the graphic display. In the present invention, the “RET” key indicated by the display data is pressed. Alternatively, if the mouse cursor is moved and the mouse is clicked at the position of the character "lower" in the display data, the state shifts to the display screen 44.

(3) The display screen 45 shows the case where the display data is displayed as "ESC: Return to menu",
By pressing the `` C '' key or clicking the mouse at the position of the display data, the screen shifts to the display screen 46 and the ES screen is displayed.
Processing corresponding to the C key code is executed.

In order to realize the input method as shown in FIG. 2 described above, the user uses an editor or the like in advance and in a predetermined data format, uses the function data file 10, the display data file 11, and the coordinate data shown in FIG. Set the necessary data in the data file 12.

FIG. 3 shows an example of the contents of the function data in the embodiment of the present invention. The first specification is an index (a number immediately after the symbol "*"), and the next specification is a key code (a numerical value ""30H","31H","32H", etc.), and the next specification is an arbitrary processing function, for example, a statement, a program, or an OS command (in the example of the figure, <black setting processing>
etc).

When the index is “2”, two keys (pen-up processing / pen-down processing) are processed for one key code “ODH”, or the processing is switched every time the key code is input. Is shown.

FIG. 4 is a diagram showing an example of display data contents.
The first specification is an index (the number immediately after the symbol "*"), and the second specification is a key code (the number "30H",
"31H", "32H", etc.), and the next designation "S or G" indicates that the display data is a character string or graphic pattern data. For example, the definition of "30H" is the graphic pattern data and the initial display. Is the character string "0", the display color is 7, the background color is "0", the display when pressed is the character string "0", the display color is "0", the background color is "7", and the display is The position (mouse input designation range) indicates a position defined as a fixed position of “1-1” in the coordinate data file. When the index is 2, the line with the key code “00H” indicates that the display data is displayed first, and is not affected by the key code input, and the line with the key code “0DH” is two. The presence of a line means that the display is switched alternately each time “0DH” is input.

FIG. 5 is a diagram showing an example of coordinate data contents according to the embodiment of the present invention. The fixed position of the rectangle for each key code is the lower right corner of the upper left coordinate (for example, the numerical value of “399, 111”). It is indicated by coordinates (for example, numerical values of “414, 126”).

The range within this rectangle is within the specified range when using the mouse.

FIG. 6 is a view showing the concept of the control data structure in the embodiment of the present invention. The key code described above, a processing function corresponding to the key code, display data of the processing function, and display data Are shown in a hierarchical structure.

Next, the flow of processing in the embodiment of the present invention will be described with reference to FIGS. 7 to 10.

In the notation method of the flowcharts shown in FIG. 7 to FIG. 10, each processing block is executed in order from the top, and those with a symbol “DO” in the upper left of the processing block indicate the contents of the block. As a judgment condition, it means that the processing content of the right block is repeatedly executed. In addition, the one with the symbol “CASE” attached at the upper left of the processing block,
This means that a condition determination is performed in the block to which the symbol “CASE” is attached, and the processing content of the block on the right is executed in accordance with the satisfaction of each condition.

First, in the “main processing” shown in FIG.
The processing of (c) is executed.

(A) First, an "initial setting process" is performed.

(B) Next, “display data processing” is executed.

(C) Finally, “input processing” is executed.

In the "initial setting process" shown in FIG. 7, the processes (a) to (l) shown in FIG. 8 are executed.

(A) First, a function data file is opened.

(B) Then, the next process (c) is continued until all data is read.

(C) Set data in the control data block.

(D) Close the function data file.

(E) Open the display data file.

(F) Then, the next process (g) is continued until all data is read.

(G) Set data in the control data block.

(H) Close the display data file.

(I) Open the coordinate data file.

(J) The following process (k) is continued until all data is read.

(K) Set data in the control data block.

(L) Close the coordinate data file.

In the "display data processing" shown in FIG. 7, the processing of (a) to (c) shown in FIG. 9 is executed.

(A) If graphic pattern data is specified, the process (b) is performed.

 If character string data is specified, the process (c) is performed.

(B) Load specified data from the graphic pattern data file and save it on the memory.

(C) Convert the specified character string data into graphic pattern data and save it on the memory.

In the "input processing" shown in FIG. 7, (a) shown in FIG.
To (i).

(A) Specify an index.

(B) Display the initial display data.

(C) Display the cursor.

(D) Repeat steps (e) and (g) until an ESC key code is input by key input or mouse input.

(E) The cursor is arbitrarily moved by key input or mouse input. However, this operation is not required if the process is executed by key input.

(F) The cursor moves.

(G) Input a designated key code by key input or mouse input, and perform the processing of (h) and (i).

(H) Display the display data when pressed.

(I) Execute a specified process.

FIG. 11 is a diagram showing a comparison between the conventional system and the system according to the present invention.

[Effects of the Invention] As described above, according to the present invention, it is possible to use both key input and mouse input by registering function data, display data, and coordinate data in a predetermined format in advance. MMI construction can be realized, and it has versatility. The data can be managed in a unified manner, and the operation is easy to understand.

[Brief description of the drawings]

FIG. 1 is a diagram showing a basic configuration of an embodiment of the present invention, FIG. 2 is a diagram showing an execution screen in the embodiment of the present invention, and FIG. 3 is an example of function data contents in the embodiment of the present invention. Figure,
FIG. 4 is a diagram showing an example of display data contents in the embodiment of the present invention, FIG. 5 is a diagram showing an example of coordinate data contents in the embodiment of the present invention, and FIG. 6 is control data in the embodiment of the present invention. FIG. 7 is a diagram showing the concept of the structure, FIG. 7 is a diagram showing a main processing flow in the embodiment of the present invention, FIG. 8 is a diagram showing an initial setting flow in the embodiment of the present invention, and FIG. 9 is an embodiment of the present invention Showing the display data processing flow in FIG. 10,
FIG. 1 is a diagram showing an input processing flow in an embodiment of the present invention,
FIG. 11 is a diagram showing a comparison between the conventional system and the system according to the present invention, and FIG. 12 is a diagram showing a flow of a conventional combined use of key input and mouse input. 10… Function data file, 11… Display data file, 12… Coordinate data file, 13… Graphic pattern data file, 14… Statement group, 15…
... Program group, 16 ... OS command group, 20 ... Key and mouse combined control unit, 21 ... Initial setting processing unit, 22 ... Display data processing unit, 23 ... Input processing unit, 30 ... Input apparatus,
31 ... keyboard, 32 ... mouse, 40 ... display device (display), 41-46 ... display screen

Claims (1)

(57) [Claims] An information processing apparatus in which a keyboard and a position input device operated by moving on a display screen are used as an input device. An arbitrary processing function is assigned to a predetermined key on the keyboard, and the key of the key is assigned to the key. In association with the code, the data relating to the processing function, the display data defining the content of the processing function and the display method of the key to be operated on the display screen, and the position of the display data on the display screen are determined. Means for registering coordinate data to be an input designation range by the position input device, and display data for a designated processing function based on the registered data at the time of input processing, and display data designated by the coordinate data. Means for displaying a graphic pattern at a position on the screen, operation of a key specified by display data on the display screen,
Or a means for confirming a position input within the input designated range by the position input device and executing a processing function corresponding to the designated key code, wherein information using both a keyboard and the position input device is provided. Processing equipment.