JPH09282079A - Information processing method and information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute corresponding command processings based on the simple operation of a pen input device through the use of the pen input device. SOLUTION: A state where the pen input device enters into a first partial space area and the first position coordinate of the pen input device in such a state are detected (S201-S202). Then, the state where the pen input device enters into a second partial space are and the second coordinate position of the pen input device in such a state are detected (S203-S204). The type of one event is selected (S208-S304) based on relation between the detected first position coordinate and second position coordinate. Thus, the processing corresponding to the selected type of the event is executed (S305).

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing method and an apparatus thereof, and more particularly to an information processing method and an apparatus thereof using a pen input device.

[0002]

2. Description of the Related Art With the development of GUI, many systems or applications for inputting using a mouse have been developed in information equipment such as computers. on the other hand,
Pen input systems have been developed and used mainly for portable information devices. This is an excellent operation to deal with the problem (space saving) that the mouse requires a place to move the mouse, or to directly operate the object displayed on the screen by pen input. This is because it has the advantage of having sex. Some pen input systems allow you to use a pen instead of a conventional mouse. In such a system, a pen can be used to perform operations conventionally performed using a mouse.

[0003]

In a system using a mouse, it is premised that a keyboard is attached, so that not only the mouse but also the keyboard may be used together for inputting. For example, xte used as terminal application software in the XWindows system.
In rm, terminal attributes such as font size can be set by pressing the "control" key and mouse button down.

However, in the pen input device, since the space saving is taken into consideration as described above, the keyboard is often not attached. In this case, in a system that uses a mouse, an application having an operation that uses a mouse and a keyboard together cannot be executed as it is in the pen input system. In order to solve this problem, the pen input system allows gestures to perform the same operation, but the problem is that the shape recognition of this gesture may be erroneously recognized or the recognition process may take time. There is.

In addition, the user must remember an operation different from that of the mouse, which causes a problem of burdening the user. As for the drag operation in the mouse system (moving the mouse while holding down the mouse button), the mouse can perform different operations depending on the number of buttons equipped on the mouse. However, the pen input system has a problem that only one type can be used.

Further, when a plurality of mouse buttons are provided as in a workstation, the operation when the most frequently used button is pressed is assigned to the pen down, so that two or more mouse buttons are used. It cannot support systems or applications that use a mouse with buttons. Also, if the pen is equipped with a switch, the same operation as when using the mouse can be performed by assigning the operation when the next most frequently used button is pressed when pen down with the switch held down. Some can.

However, even in this case, a mouse having three or more buttons cannot be supported. The present invention has been made in view of the above-described conventional example, and provides an information processing method and an apparatus for using a pen input device to execute corresponding command processing based on a simple operation of the pen input device. The purpose is to do.

[0008]

In order to achieve the above object, an information processing method and apparatus of the present invention have the following configurations. That is, a state in which the pen input device is placed in the first partial space area, a first detecting means for detecting the first position coordinate of the pen input device in the state, and a pen input device is placed in the second partial space area. State, second detection means for detecting the second coordinate position of the pen input device in the state, first position coordinates detected by the first detection means, and second position detected by the second detection means Based on the relationship between the coordinates,
A selection unit for selecting one event type and an execution unit for executing a process corresponding to the event type selected by the selection unit are provided.

Another invention is a first state in which a pen input device is placed in a first partial space area, a first time in the first state, and a first state of the pen input device in the first state.
First detecting means for detecting position coordinates; a second state in which a pen input device is placed in the first partial space area; a second time in the second state; and pen input in the second state Second detection means for detecting a second position coordinate of the device, and a time difference between a first time detected by the first detection means and a second time detected by the second detection means is a predetermined threshold time. If it is larger than the value, selection means for selecting one event type based on the relationship between the first position coordinates detected by the first detection means and the second position coordinates detected by the second detection means, And an execution unit that executes a process corresponding to the type of event selected by the selection unit.

Another aspect of the present invention is a state in which a pen input device is placed in the first partial space area, a detecting means for detecting a position coordinate of the pen input device in the state, and a position coordinate detected by the detecting means. Counting means for counting the number of repetitions of repeating the state in which the pen input device enters the vicinity area of the predetermined size including the position coordinates detected by the detection means after the pen input device comes out of the vicinity area of the predetermined size including And a selecting means for selecting one event type based on the number of repetitions counted by the counting means, and an executing means for executing a process corresponding to the event type selected by the selecting means.

Another aspect of the present invention is to detect a position of the pen input device in the first partial space area, a time of the state, and a detecting means for detecting the position coordinate of the pen input device in the state, and the detecting means. After the pen input device has moved out of the vicinity area of the predetermined size including the position coordinates detected by, the pen input device enters the vicinity area of the predetermined size including the first position coordinates detected by the detection means. Counting means for counting the number of repetitions repeated within a predetermined time, selection means for selecting one event type based on the number of repetitions counted by the counting means, and event type selected by the selection means And an execution unit that executes a corresponding process.

Another aspect of the invention is a state in which the pen input device is placed in the first partial space area, a first detecting step of detecting the first position coordinate of the pen input device in the state, and a second portion. With the pen input device in the space area,
A second detection step of detecting the second coordinate position of the pen input device in the state, and a relationship between the first position coordinate detected in the first detection step and the second position coordinate detected in the second detection step. On the basis of the above, a selection step of selecting one event type and an execution step of executing a process corresponding to the event type selected in the selection step.

Another invention is a first state in which a pen input device is placed in a first partial space area, a first time in the first state, and a first state of the pen input device in the first state.
A first detection step of detecting the position coordinates, a second state in which a pen input device is placed in the first partial space area, a second time in the second state, and pen input in the second state. A second detection step of detecting a second position coordinate of the device, and a time difference between a first time detected in the first detection step and a second time detected in the second detection step is a predetermined threshold time. If larger than the value, a selection step of selecting one event type based on the relationship between the first position coordinates detected in the first detection step and the second position coordinates detected in the second detection step, And an execution step of executing a process corresponding to the type of event selected in the selection step.

Another aspect of the present invention is a state in which a pen input device is placed in the first partial space area, a detecting step of detecting the position coordinate of the pen input device in the state, and a position coordinate detected in the detecting step. A counting step of counting the number of repetitions of repeating the state in which the pen input device enters the vicinity area of the predetermined size including the position coordinates detected in the detection step after the pen input device comes out of the vicinity area of the predetermined size including And a selecting step of selecting one event type based on the number of repetitions counted in the counting step, and an executing step of executing a process corresponding to the event type selected in the selecting step.

Another aspect of the present invention is to detect a state in which the pen input device is placed in the first partial space area, a time of the state, and a position coordinate of the pen input device in the state, and the first detecting step. After the pen input device comes out of the vicinity area of the predetermined size including the position coordinates detected in step 1, the pen input device enters the vicinity area of the predetermined size including the first position coordinates detected in the detection step. A counting step of counting the number of repetitions repeated within a predetermined time, a selection step of selecting one event type based on the number of repetitions counted in the counting step, and an event type selected in the selection step. And an execution step of executing a corresponding process.

Yet another invention is a computer program product comprising a computer usable medium having computer readable program code means, the computer program product comprising a pen input device in a first subspace area. And a second computer-readable program code means for detecting the first position coordinate of the pen input device in the state where
Detecting a state in which the pen input device is placed in the partial space area of, and a second coordinate position of the pen input device in the state.
An event based on a computer-readable second program code means and a relationship between a first position coordinate detected by the first program code means and a second position coordinate detected by the second program code means. Computer-readable third program code means for selecting the type of the event, and computer-readable fourth program code means for executing processing corresponding to the event type selected by the third program code means. .

Yet another invention is a computer program product comprising a computer usable medium having computer readable program code means, the computer program product comprising a pen input device in a first subspace area. A computer readable first program code means for detecting a first state in which a mark has entered, a first time in the first state, and a first position coordinate of the pen input device in the first state; A second state in which the pen input device is located in the first partial space area, a second time in the second state, and a second position coordinate of the pen input device in the second state; The second program code means, the first time detected by the first program code means, and the second program code means Between the first position coordinate detected by the first program code means and the second position coordinate detected by the second program code means, if the known time difference between the second times is larger than a predetermined threshold time value. A computer readable third program code means for selecting one event type based on the relation of ## EQU1 ## and a computer readable program for executing a process corresponding to the event type selected by the third program code means. Fourth
Program code means.

Yet another invention is a computer program product comprising a computer usable medium having computer readable program code means, said computer program product having a pen input device in a first subspace area. A computer-readable first program code means for detecting the position coordinates of the pen input device in the state where the
After the pen input device goes out of the vicinity area of a predetermined size including the position coordinates detected by the program code means,
A computer readable second program code means for counting the number of times of repeating the state in which the pen input device is placed in the vicinity area of a predetermined size including the position coordinates detected by the first program code means; and the second program code. Computer-readable second program code means for selecting one event type based on the number of repetitions counted by the means, and processing corresponding to the event type selected by the third program code means Computer readable third program code means. Another invention is a computer program product, comprising a computer usable medium having computer readable program code means, the computer program product having a pen input device in the first subspace region. A computer-readable first program code means for detecting the state, the time of the state, and the position coordinate of the pen input device in the state, and a vicinity area of a predetermined size including the position coordinate detected by the first program code means After the pen input device comes out, the number of times of repeating the state in which the pen input device enters the vicinity area of a predetermined size including the first position coordinates detected by the first program code means within a predetermined time is counted,
Computer readable second program code means, computer readable third program code means for selecting one event type based on the number of repetitions counted by the second program code means, and the third Computer readable fourth program code means for executing a process corresponding to the type of event selected by the program code means.

[0019]

BEST MODE FOR CARRYING OUT THE INVENTION First, after summarizing the points of an information processing method and an apparatus thereof according to an embodiment of the present invention, a detailed description thereof will be given. According to the information processing method and the apparatus thereof according to the embodiments of the present invention, an application supporting a pointing input device such as a mouse or a program on the system side can be used as it is, and the operation input supported by the mouse is replaced with a pen input device. You can

For example, when a pen input device is used in place of the mouse in a workstation that supports a mouse having three buttons, the direction of the pen tip of the pen input device is detected, and input is made from the left side. Performs the operation corresponding to the left button down of the three-button mouse, and performs the processing corresponding to the middle button down from directly above and the right button down from the right side. By doing so, the application used in the mouse operation environment can be used in the pen operation environment without changing.

The information processing method and its apparatus according to the embodiment of the present invention will be described below in detail. [First Embodiment] FIG. 1 shows a schematic configuration of an information processing apparatus according to the present embodiment. The CPU 200 controls the entire information processing apparatus by reading, interpreting, and executing various control programs stored in the memory 202.

The pen input device 206 inputs the coordinates of the pen and the status of the pen. Keyboard 20
3 and the pointing device 204 input commands and data. The display monitor 201 is a CPU
The processing result of 200 and the commands and data input from the keyboard 203 and the pointing device 204 are displayed.

The timer 205 counts the current time and notifies the current time based on a request from the CPU 200. FIG. 2 shows a schematic processing configuration processed by the information processing apparatus of FIG. Referring to FIG. 2, reference numeral 1 denotes a pen input unit for receiving data (coordinate data and status) input by a pen. Reference numeral 2 is an input attribute detection unit for detecting an input attribute from the input data. The input attribute is the moving direction of the pen tip. That is, as will be described later, the status is "proximity within" coordinate values and "pen down"
The moving direction of the pen tip is detected by the coordinate value of.

Reference numeral 3 is an event conversion unit for generating an event corresponding to each mouse button based on the attribute detected by the input attribute detection unit 2, in other words, for converting a pen event into a mouse event. An event execution unit 4 executes an operation corresponding to the event sent from the event conversion unit.

The processing in each of these units is stored as a program in the memory 202 and is executed by the CPU 200. Although the outline of the processing is described in FIG. 2, a more detailed processing procedure will be described with reference to FIGS. 3 and 4. Here, a case will be described where a pen input device such as an electromagnetic induction type tablet that can detect coordinates even when the pen tip is not attached to the tablet surface is used.

At this time, when the coordinates are detected together with the coordinate values from the input device, is the pen tip attached to the tablet surface, or is the pen tip within a certain distance from the tablet surface, or Data is sent indicating whether the tip is more than a certain distance away from the tablet surface. In the following, if the pen tip is within a certain distance from the tablet surface, it is called "the pen tip is in proximity", and if the pen tip is more than a certain distance from the tablet surface, " The pen tip is outside the proximity. "

On the other hand, a state in which the pen tip is attached to the tablet surface is called "pen down". Below,
With a mouse, a mouse button press event occurs only when the mouse button is pressed. In addition, in the initial state, it is assumed that the pen tip is outside the proximity. No data will be sent from the pen input device if the pen tip is out of proximity. That is, the status of coordinate data is sent when the pen tip is in proximity and when the pen is down.

In the following description, various variable names necessary for processing appear without notice, but these are stored in the memory 202.
Be assigned to. In step S201, the coordinate value and the status (one of the above states) are acquired from the pen input device. In step S202, the status is checked to determine whether the pen tip is in proximity. If it is within proximity, the process proceeds to step S203, and if not, the process returns to step S201.

In step S203, step S201
The coordinate value and the status input in step 3 are stored in the memory 202. Then, the next coordinate value and status are input from the pen input device. In step S204, step S2
The status entered in 03 is checked to determine whether it is a pen down. If the pen is not down, the process proceeds to step S205, and the input coordinate data of the input is stored in the memory 2
02 is stored. Then, the process returns to step S201 to obtain the next input.

If it is determined in step S204 that the pen is down, the process proceeds to step S208. In step S208, the direction from which the pen tip is input is calculated. That is, step S20
By comparing the coordinate data in the proximity before pen-down stored in 3 and the value in the X-direction (horizontal direction) of the coordinate data during pen-down, whether the pen tip is pen-down from the left side or pen-down from the right side Determine if you did.

If the difference between the two points in the X direction is less than or equal to a predetermined threshold value, it is determined that the input has been made from the above. Therefore, it is possible to detect whether the input is in three directions. When it is determined in step S208 that the input is from the left side, the direction status ds is set to "0". Further, if it is roughly, the direction status ds is set to "1". Also,
From the right side, the direction status ds is set to "2".

In step S209, step S208
The direction status ds obtained in step S4 is stored in the memory 2020. In step S301, the direction status ds is checked, and if it is "0", the process proceeds to step S302. In the case of "1", the process proceeds to step S303. If it is "2", the process proceeds to step S304.

In steps S302, S303, and S304, left, middle, and right mouse button press events are generated, respectively. That is, step S30
1, Step S302, Step S303, Step S
By each process of 304, pen input data is converted into a mouse event. In step S305, a predetermined process corresponding to each input event is executed. The process in step S305 is adaptively set on the application side or the operating system side. When the processing in step S305 ends,
In order to obtain the next input, the process returns to step S201 and the same process is repeated.

As described above, by using the pen input method of the present embodiment, a pen input device such as an electromagnetic induction type which can obtain the coordinate value of the pen tip without pen down on the input surface is used. In this case, by using the coordinate value before pen down and the coordinate value when pen down,
You can use the pen to perform the same operations as when using a mouse with multiple buttons. [Second Embodiment] In the second embodiment, a case of using a pen input device that obtains coordinate values when a pen tip touches the input surface will be described with reference to FIGS. 5 and 6. .

The pen input device outputs the following coordinate data when the pen is down and when the pen is down and a certain distance or more from the previously output coordinates, and when the pen is up, the coordinates of the position are output. Output data and status. Here, the status is "1" when the pen is down, and "0" when the pen is up.

Further, in the following description, as in the first embodiment, a description will be given of a case where a mouse button pressing event occurs only when the mouse button is pressed on the mouse side. Hereinafter, detailed processing corresponding to the configuration will be described with reference to FIGS. 5 and 6. Here, it is assumed that the pen-up state is set at the start of the process.

In step S401, it is determined whether there is a pen down input from the pen input device. And if there is no input, wait until there is input. If there is an input, the process proceeds to step S402. Step S40
In 2, the current time is input from the timer 205 and stored in the memory 202 together with the pen-down coordinate value input in step S401 and its status.

In step S403, the next input from the pen input device is awaited. Then, if there is an input, the process proceeds to step S404. In step S404, it is determined whether the input is pen-up. If it is pen-up, the process returns to step S401. Otherwise, step S405
Proceed to. In step S405, the current time is input from the timer 205 and stored in the memory 202 together with the coordinate value and status input in step S403.

In step S406, step S402
The difference between the time held in step S405 and the time held in step S405 is calculated, and in step S406 it is determined whether the difference is larger than a predetermined threshold value. If it is smaller than the predetermined threshold value, the process returns to step S403 to obtain the next input. On the contrary, when it is larger than the threshold value, step S4
Proceed to 07.

In step S407, it is determined whether the pen tip has moved leftward or rightward. Here, by comparing the X-direction (horizontal direction) value of the coordinate value held in step S402 with the X-direction value held in step S405, it is determined whether the pen tip has moved to the left or to the right. To do. If the difference between the two points in the X direction is less than or equal to a predetermined threshold value, it is determined that the pen tip is not moving.

Then, the direction status ds is set to "0" when the pen tip has moved to the left, "1" when it has not moved, and "2" when it has moved to the right. In step S408, the direction status ds of this determination result is stored in the memory 202.
To be stored. In step S501, the direction status d
Check s, and if "0", step S502
In the case of "1", the process branches to step S503, and in the case of "2", the process branches to step S504.

In steps S502, S503, and S504, left, middle, and right mouse button press events are generated, respectively. That is, step S50
1, step S502, step S503, step S
By each processing of 504, the pen input data is converted into a mouse event. In step S505, a predetermined process corresponding to each input event is executed. The processing in step S505 is adaptively set on the application side or the operating system side.

When the processing in step S505 ends,
Again, the process is performed by the pen input unit 1, and step S506 is performed.
Then, the process of step S508 is executed. Step S5
At 06, wait until the next input is obtained from the pen input device. Then, if there is an input, the process proceeds to step S507. In step S507, it is determined whether the input status is pen-up. If it is pen-up, the process starts again from step S401. Otherwise, it proceeds to step S508.

In step S508, the current direction status ds and the coordinate value obtained in step S506 are sent to the event execution section, and the process returns to step S501. As described above, by using the pen input method of the present embodiment, even when using a pen input device that can obtain coordinate values only when the pen tip touches the input surface, the coordinate values at the time of pen down By using the coordinate value moved within a certain minute time after pen down, the same operation as when using a mouse having a plurality of buttons can be performed with the pen. [Third Embodiment] In the third embodiment, a method different from the above-described embodiments will be described. The point of the present embodiment is to count the number of times the pen passes through a neighboring area of a predetermined size including the position where the pen input device is pen-downed, and perform processing to correspond to each button of the mouse.

Here, in order to facilitate the reader's understanding,
For example, when the drawing application uses a mouse and a keyboard, and when the mouse is only dragged, a mode for drawing a free curve corresponding to the movement of the mouse, shift (shi
When the ft) key is pressed and dragged from a predetermined drawing object, it is assumed that the drawing object is copied and the copied object is moved.

In order to perform these modes by using the pen input device, in the present embodiment, the stroke to be input after pen down goes out from the vicinity of the input start point of a preset size, and the input start point is again set. When pen-up is performed without passing through the vicinity, a mode is provided for displaying the stroke as it is. Also, pen down on any drawing object, then the stroke exits from the vicinity of the input start point, passes near the input point that was input again, and then passes in the window without passing near the input start point. When pen-up is performed at the position of, the mode for moving the drawing object at the input start position to the position where the pen-up is performed is provided.

Further, pen down on an arbitrary drawing object, and subsequent strokes make two strokes near the input start point.
A mode is provided in which the drawing object at the input start position is copied and the copied object is moved to the pen-up position when the object has passed through and pen-up at an arbitrary position in the window. By providing the above processing mode, the application used in the mouse / keyboard environment can be used in the pen operation environment without changing the source code or the like.

Further, in order to distinguish the events by the number of times of passing the vicinity of the input start point, the process is extremely simple as compared with the conventional process of inputting a gesture of a pen input device and recognizing its shape. Will be things. The processing in the third embodiment will be described based on the flowcharts of FIGS. 7 and 8.

In step S601, various variable names are initialized. The initialization items include the number of times the stroke has passed the vicinity of the input start point (hereinafter, referred to as the neighborhood passage number cnt), and a flag indicating whether or not the previous input data was within the vicinity of the input start point (hereinafter, Neighborhood flag fl
It is set to "0" respectively.

The vicinity of the input start point is a square area centered at the input start, and its size is predetermined, but the size is reset by the user's menu operation. It is also possible. In step S602, a pen-down input from the pen input device is awaited. Then, if the displayed object is present at the input position, the process proceeds to step S603. If it does not exist, it waits for a pen down input from the pen input device.

In step S603, the point is set as the input start point, the neighboring area is set, and the in-neighbor flag is set. In step S604, the next pen down movement input (pen movement with the pen down) or pen up input is waited for by the user. Then, if there is a pen down movement input, the process proceeds to step S605. If there is pen-up input, the process returns to step S601.

In step S605, step S604
It is checked whether or not the coordinates of the point obtained in step S603 are in the neighborhood area set in step S603. If it is within that area, the process proceeds to step S606, and if not, the process proceeds to step S702. In step S606, it is checked whether the coordinates of the point obtained in step S604 are within the vicinity of the input start point. If it is not within the neighborhood, the process proceeds to step S607, the neighborhood flag is reset, the process returns to step S604, and waits for the next input.

On the other hand, if it is determined in step S606 that the vehicle is in the vicinity, the process proceeds to step S608. In step S608, it is checked whether or not the neighborhood flag is set, and if it is not set, step S6
Go to 09. If set, step S6
Return to 04.

In step S609, the number of neighboring passages cnt
Is counted up by one. In step S610, the in-proximity flag is set. Then, the process returns to step S604 to wait for the next input. In step S701, the number of neighboring passages cnt is checked in step S702, and "0" is checked.
In the case of, it progresses to step S703. If it is "1", the process proceeds to step S704. In the case of "2", the process proceeds to step S705.

In step S703, a button press event is generated. In step S704, a control key press event + mouse button press event is generated. In step S705, a shift key press event + mouse button press event is generated.

In this way, steps S702 to S70
By each processing of 5, the pen input data is converted into a mouse + keyboard event. In step S706, the event thus converted is subjected to each process corresponding to the event. In step S707, it is checked whether there is a new pen input. When pen-up is input, the process returns to step S601. If not, the process returns to step S702, and the process is continued based on the obtained coordinate value of the input point and the held number of neighboring passes.

Incidentally, steps S703 and S70
The various events generated in any one of step 4 and step S705 are stored in the event correspondence table (stored in the memory 202) between the devices prepared in advance as shown in FIG. By pulling
You can get the event of the conversion destination. In addition, the event correspondence table is changed by the user's menu operation,
Can be added or deleted.

Next, FIG. 10 shows an example of screen operation in the pen input method of the present embodiment. This shows an operation example in the case where the operation target object is copied and moved by dragging the mouse with the shift key held down on the side of the information processing apparatus having a mouse and a keyboard. In this example, when the number of passing neighborhoods is 1, it is converted into a shift key pressing event and a mouse button pressing event.

As described above, when the pen input method according to the present embodiment is used, the input stroke is started by the time when the stroke is centered on the input start point and is out of the preset large area. An event can be generated that is identified by the number of times it has passed near the point. Then, by assigning this event to the operation that uses the mouse and keyboard together, an application or system that was created on the assumption that the conventional mouse and keyboard are used is based on pen input without changing the source code. become able to.

(Fourth Embodiment) In the fourth embodiment, a processing method for generating each event by further using the input time information regarding the stroke will be described with reference to FIG.
The point of the processing in the present embodiment is that if the time until the input stroke from the pen input device leaves the vicinity of the input start point and then the stroke enters the vicinity of the input start point within a predetermined time It is determined to pass, and if not, the number of times of passing until then is detected as an input attribute.

Referring to FIG. 11, in step S801, the following variable names are initialized. That is, the number of times the stroke has passed in the vicinity of the input start point (hereinafter referred to as the "neighboring passage number pcnt"), and a flag indicating whether or not the previous input data was within the vicinity of the input start point (hereinafter, "
Each of the in-neighborhood flags nflg) is initialized to “0.” The neighborhood of the input start point is a square area having a predetermined size centered on the input start point.
This size can be reset by a user's menu operation.

Further, in the present embodiment, the count-up of the number of near passages pcnt is performed based on whether the time difference between the present time and the time near the previous input start point is within a predetermined threshold value. . This predetermined threshold can be reset by the user's menu operation. In step S802, the pen-down input is waited for. If an object exists at the position where the pen-down input is made,
It proceeds to step S803. Here, the object is
Each object is an object on the displayed image, and each information including the position information on the display 201 regarding this object is stored in the memory 202. Then, by comparing this position information with the position of the pen-down input, it can be determined whether or not the object exists at the position where the pen-down input is made.

In step S803, the pen-down position is used as the input start point to set the neighborhood area, and the in-neighborhood flag nflg is set. Step S6
In 04, the current time is acquired from the timer 205 and stored in the memory 202 (hereinafter, this time is referred to as the reference time). In step S805, the next pen down movement input (movement with pen down) is waited, and if there is this input, the process proceeds to step S806. In addition, when pen-up is performed in step S805, step S
Return to 801. In step S806, the current time is acquired.

In step S807, step S804
And the time acquired in step S806 are compared, and it is determined whether the difference is larger than a predetermined threshold value. If it is larger, the same process as the event conversion process in the third embodiment is performed. That is, since the same processing as the processing from step S702 in FIG. 8 is performed, the description thereof will be omitted here to avoid duplication of description. If not larger, the process proceeds to step S808.

In step S808, it is checked whether the current input point is near the input start point. If it is not within the vicinity, the process proceeds to step S809. If it is within the vicinity, step S8
Proceed to 12. In step S809, the flag nf in the neighborhood
Check if lg is set. If not set, the process returns to step S805. On the contrary, if it is set, the process proceeds to step S810.

In step S810, the current time is input from the timer 205 and stored in the memory 202 as the reference time. In step S811, the flag nfl in the vicinity is set.
reset g. Then, the process returns to step S805.
If it is determined in step S808 that the in-neighborhood flag nflg is set, it is checked in step S812. Then, if it is set, the process returns to step S805, and if not, the process proceeds to step S813, and the neighboring passage number pcnt is incremented by "1".

In step S814, the in-neighborhood flag nf
Set lg. Then, the process returns to step S805,
Wait for the next input. As described above, when the pen input method of the present embodiment is used, if the stroke once leaves the vicinity of the input start point and then the stroke enters the vicinity of the input start point within a certain time. If it is judged as passing,
If not, the number of times passed so far is confirmed as the input attribute. Then, based on the determined number of times, a corresponding event, for example, a predetermined operation using a mouse and a keyboard together is assigned. With this, the conventional mouse,
Instead of using a keyboard, you can do it with just a pen.

In the present embodiment, if the stroke leaves the vicinity of the input start point and then the stroke reaches the vicinity of the input start point within a predetermined time, it is regarded as passing, otherwise. , The number of times of passing up to that time is detected as an input attribute, but if the process in step S811 of FIG. 11 is not performed, the number of times of passing near the input start point within a fixed time from the input start time is used as an input attribute. It is possible.

The same effect can be obtained by using a combination of the input attribute detection methods described in the third and fourth embodiments as the input attribute detection method. (Fifth Embodiment) FIG. 12 shows the outline of the processing arrangement according to the fifth embodiment of the present invention. Reference numeral 71 in FIG. 12 is a pen input unit for receiving data input by the pen. Reference numeral 72 is an input attribute detection unit for detecting an input attribute from the input stroke. In the present embodiment, the number of times the input stroke has passed the vicinity of the input start point before coming out of the area having a predetermined size centered on the input start point is used as the input attribute.

Reference numeral 73 is an event execution unit for executing a corresponding event based on the attribute detected by the input attribute detection unit 72. FIG. 13 shows the event execution unit 73.
The flowchart of the process in (FIG. 12) is shown. Also, FIG.
Reference numeral 4 indicates the correspondence between the number of neighboring passages held by the event execution unit 73 and the command.

The event execution process will be described below with reference to FIG. The flow of pen input and input attribute detection processing is the same as in the third embodiment. That is, when each step in FIG. 7 is executed and the branch condition in step S605 is satisfied, the entry is made in step S902 (FIG. 13). In step S902, the number of neighborhood passages generated by the input attribute detection unit 2 is checked, and based on the number, steps S803, S904, and S905.
Branch to each step. In these steps, FIG.
A command corresponding to the number of neighboring passes is generated according to the correspondence between the number of neighboring passes and the command.

In step S902, the number of neighboring passes is "0".
In the case of, the process branches to step S803, in the case of "1", to step S804, and in the case of "2", to step S805. In step S803, a delete command is generated. Then, in step S806, the next input is awaited. Then, when there is no more input, the delete command is executed (step S807), and step S6 of FIG.
Go to 01.

On the other hand, in step S804, a move command is generated. Next, in step S908, the move command is executed based on the move command and the current coordinate value. In step S809, the movement command is repeated until the input is awaited and the pen is moved up. Then, the process proceeds to step S601 in FIG.

On the other hand, in step S805, a copy command is generated. Next, in step S810, the number of neighboring passes is set to "1". Then, in step S808, the copy command is executed. Then, step S8
Wait for the next input at 09, and move the pen move (Pen move
In the case of e), the move command is executed until the pen is up.

Incidentally, steps S807 and S808
The execution of the command in (1) is normally prepared by the system that implements this method, and a detailed description thereof will be omitted here. As described above, when the pen input method of the present embodiment is used, the input stroke passes through the vicinity of the input start point before leaving the area of a preset size centered on the input start point. By assigning commands prepared by the system or application depending on the number of times you have done, not only can you operate the conventional system or application with the pen without changing the source code etc., but also the shape based on gesture input It is possible to solve the problem of erroneous recognition and long recognition time that occur due to recognition.

The present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Further, an object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus,
Computer (or CP) of the system or device
It is needless to say that it is also achieved by (U or MPU) reading and executing the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, C
A D-ROM, a CD-R, a magnetic tape, a non-volatile memory card, a ROM, etc. can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the above-mentioned storage medium, the storage medium stores the program code corresponding to the above-mentioned flow chart. Briefly, in the memory map example of FIG. Each module corresponding to the processing of each of the above-described flowcharts will be stored in the storage medium. That is, at least the "pen input processing module" that inputs the state and coordinates of the pen, and the "input attribute that identifies the event based on the movement of the coordinate value and the time of the dynamic pen movement as described above. Store the program code of each module of "detection module", "event conversion module" that converts the identified event into an event such as a mouse, and "command execution module" that executes the command corresponding to the converted event in a storage medium. Good.

As described above, according to the present embodiment, in a system using a mouse and a keyboard, even an application having an operation of simultaneously using the mouse and the keyboard can directly operate the pen without changing the source code. Can be used in the environment. In addition to providing an environment that can be operated only with a pen,
It is possible to solve problems such as erroneous recognition, recognition time, and the like that occur when recognizing the shape of a gesture.

Also, the user does not have to learn a new operation, and can use the mouse with the same interval feeling as a conventional mouse operation.

[0083]

As described above, according to the present invention, a pen input device can be used to execute corresponding command processing based on a simple operation of the pen input device.

[Brief description of drawings]

FIG. 1 is a diagram showing a basic configuration example of an information processing apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating an outline of a processing configuration according to the first embodiment.

FIG. 3 is a flowchart showing a flow of processing according to the first embodiment.

FIG. 4 is a flowchart showing a flow of processing in the first embodiment.

FIG. 5 is a flowchart showing the flow of processing in the second embodiment.

FIG. 6 is a flowchart showing the flow of processing in the second embodiment.

FIG. 7 is a flowchart showing the flow of processing in the third embodiment.

FIG. 8 is a flowchart showing the flow of processing in the third embodiment.

FIG. 9 is an event conversion correspondence table referred to in event conversion processing.

FIG. 10 is a diagram showing an example of a locus of pen input on the display screen.

FIG. 11 is a flowchart showing the flow of processing of the fourth embodiment.

FIG. 12 is a diagram for explaining an outline of processing according to the fifth embodiment.

FIG. 13 is a flowchart of the process of the fifth embodiment.

FIG. 14 is a diagram showing the correspondence between the number of neighboring passes and commands.

FIG. 15 is a diagram showing a layout of each program module stored in a predetermined computer-readable recording medium.

Claims (36)

[Claims] 1. A state in which a pen input device is placed in a first partial space area, a first detecting means for detecting a first position coordinate of the pen input device in the state, and a pen input in a second partial space area. A state in which the device is inserted, a second detecting means for detecting a second coordinate position of the pen input device in the state, a first position coordinate detected by the first detecting means and the second
Selection means for selecting one event type based on the relationship between the second position coordinates detected by the detection means; and execution means for executing processing corresponding to the event type selected by the selection means. An information processing device comprising: 2. The information processing apparatus according to claim 1, wherein the first partial space area is a partial space area at a predetermined distance from a position slightly away from the pen input tablet. 3. The information processing apparatus according to claim 1, wherein the second partial space area is a contact partial space between a pen input tablet and the pen input device. 4. The selecting means, when the magnitude of the vector from the first position coordinate detected by the first detecting means to the second position coordinate detected by the second detecting means is equal to or larger than a predetermined threshold value. Is a vector that selects one event type based on the direction of the vector and moves from the first position coordinate detected by the first detection unit to the second position coordinate detected by the second detection unit. The information processing apparatus according to claim 1, wherein when the size is not equal to or larger than a predetermined threshold value, another event type is selected. 5. The information processing apparatus according to claim 2, wherein the pen input tablet is an electromagnetic induction type tablet. 6. The information processing apparatus according to claim 1, wherein the type of the event corresponds to the type of each button of the pointing input device. 7. A first state in which a pen input device enters a first partial space area, a first time in the first state, and first position coordinates of the pen input device in the first state are detected. First detecting means, a second state in which the pen input device is placed in the first partial space area, a second time of the second state, and a second position of the pen input device in the second state. If the time difference between the first detection time detected by the first detection means and the second detection time detected by the second detection means is larger than a predetermined threshold time value, Selecting means for selecting one event type based on the relationship between the first position coordinates detected by the first detecting means and the second position coordinates detected by the second detecting means; and selecting by the selecting means Execution means for executing the process corresponding to the type of event An information processing apparatus comprising: 8. The information processing apparatus according to claim 7, wherein the first partial space area is a contact partial space between a pen input tablet and the pen input device. 9. The selecting means, when the magnitude of the vector from the first position coordinate detected by the first detecting means to the second coordinate position detected by the second detecting means is equal to or larger than a predetermined threshold value. Is a vector that selects one event type based on the direction of the vector and moves from the first coordinate position detected by the first detection unit to the second coordinate position detected by the second detection unit. The information processing apparatus according to claim 7, wherein another type of event is selected when the size is not equal to or larger than a predetermined threshold value. 10. The information processing apparatus according to claim 7, wherein the type of the event corresponds to the type of each button of the pointing input device. 11. A state in which a pen input device is placed in the first partial space area, a detection unit for detecting the position coordinate of the pen input device in the state, and a predetermined size including the position coordinate detected by the detection unit. Counting means for counting the number of repetitions of repeating the state in which the pen input device enters the vicinity area of a predetermined size including the position coordinates detected by the detection means after the pen input device comes out of the vicinity area; and the counting means. Information comprising: a selection unit that selects one event type based on the number of repetitions counted in 1. and an execution unit that executes a process corresponding to the event type selected by the selection unit. Processing equipment. 12. The information processing apparatus according to claim 11, wherein the first partial space area is a contact partial space between a pen input tablet and the pen input device. 13. The information processing apparatus according to claim 11, wherein the type of event corresponds to the type of each button of the pointing input device. 14. A state in which a pen input device is placed in a first partial space area, a time of the state, and a detection unit for detecting a position coordinate of the pen input device in the state, and a position coordinate detected by the first detection unit. After the pen input device has come out of the vicinity area of a predetermined size including, the state in which the pen input device enters the vicinity area of the predetermined size including the first position coordinates detected by the detecting means is repeated within a predetermined time. Counting means for counting the number of repetitions, selecting means for selecting one event type based on the number of repetitions counted by the counting means, and executing processing corresponding to the type of event selected by the selecting means An information processing apparatus comprising: an executing unit that executes the information processing apparatus. 15. The information processing apparatus according to claim 14, wherein the first partial space area is a contact partial space between a pen input tablet and the pen input device. 16. The information processing apparatus according to claim 14, wherein the type of the event corresponds to the type of each button of the pointing input device. 17. A state in which a pen input device is placed in the first partial space area, and a first state of the pen input device in the state.
A first detection step of detecting the position coordinates, a state in which the pen input device is placed in the second partial space area, a second detection step of detecting the second coordinate position of the pen input device in the state, and the first The first position coordinate detected in the detection step and the second position coordinate
A selection step of selecting one event type based on the relationship between the second position coordinates detected in the detection step, and an execution step of executing a process corresponding to the event type selected in the selection step. An information processing method comprising: 18. The information processing method according to claim 17, wherein the first partial space area is a partial space area at a predetermined distance from a position slightly away from the pen input tablet. 19. The information processing method according to claim 17, wherein the second partial space area is a contact partial space between a pen input tablet and the pen input device. 20. In the selecting step, when the magnitude of a vector from the first position coordinate detected in the first detecting step to the second position coordinate detected in the second detecting step is equal to or larger than a predetermined threshold value. Is a vector that selects one event type based on the direction of the vector and moves from the first position coordinate detected in the first detection step to the second position coordinate detected in the second detection step. 18. The information processing method according to claim 17, wherein another event type is selected when the size is not equal to or larger than the predetermined threshold value. 21. The information processing method according to claim 18, wherein the pen input tablet is an electromagnetic induction type tablet. 22. The information processing method according to claim 17, wherein the type of the event corresponds to the type of each button of the pointing input device. 23. Detecting a first state in which a pen input device enters the first partial space area, a first time in the first state, and a first position coordinate of the pen input device in the first state. A first detecting step, a second state in which the pen input device enters the first partial space area, a second time in the second state, and a second position of the pen input device in the second state. If the time difference between the second detection step of detecting the coordinates and the first time detected in the first detection step and the second time detected in the second detection step is greater than a predetermined threshold time value, A selection step of selecting one event type based on the relationship between the first position coordinates detected in the first detection step and the second position coordinates detected in the second detection step; and selection in the selection step Process that executes the process corresponding to the type of event An information processing method comprising: 24. The information processing method according to claim 23, wherein the first partial space area is a contact partial space between a pen input tablet and the pen input device. 25. In the selecting step, when the magnitude of a vector from the first position coordinate detected in the first detecting step to the second coordinate position detected in the second detecting step is equal to or larger than a predetermined threshold value. Is a vector that selects one event type based on the direction of the vector and moves from the first coordinate position detected in the first detection step to the second coordinate position detected in the second detection step. The information processing method according to claim 23, wherein when the magnitude is not equal to or larger than a predetermined threshold value, another event type is selected. 26. The information processing method according to claim 23, wherein the type of the event corresponds to the type of each button of the pointing input device. 27. A state in which a pen input device is placed in the first partial space area, a detection step of detecting the position coordinates of the pen input device in the state, and a predetermined size including the position coordinates detected in the detection step. A counting step of counting the number of times of repeating the state in which the pen input device enters the vicinity area of a predetermined size including the position coordinates detected in the detection step after the pen input device comes out of the vicinity area; and the counting step. Information comprising: a selection step of selecting one event type based on the number of repetitions counted in 1 .; and an execution step of executing a process corresponding to the event type selected in the selection step. Processing method. 28. The information processing method according to claim 27, wherein the first partial space area is a contact partial space between a pen input tablet and the pen input device. 29. The information processing method according to claim 28, wherein the type of the event corresponds to the type of each button of the pointing input device. 30. A detection step of detecting a position of a pen input device in a first partial space area, a time of the state, and a position coordinate of the pen input device in the state; and a position coordinate detected in the detection step. After the pen input device comes out of the vicinity area of a predetermined size including, the state in which the pen input device enters the vicinity area of the predetermined size including the first position coordinate detected in the detection step is repeated within a predetermined time. A counting step of counting the number of repetitions, a selection step of selecting one event type based on the number of repetitions counted in the counting step, and a process corresponding to the type of event selected in the selection step An information processing method, comprising: 31. The information processing method according to claim 30, wherein the first partial space area is a contact partial space between a pen input tablet and the pen input device. 32. The information processing method according to claim 30, wherein the type of the event corresponds to the type of each button of the pointing input device. 33. A computer program product, comprising a computer usable medium having computer readable program code means, said computer program product having a pen input device in a first subspace region. A computer readable first program code means for detecting a first position coordinate of the pen input device in the state, a state in which the pen input device is contained in the second partial space area, and a state of the pen input device in the state. Computer-readable second program code means for detecting a second coordinate position, between the first position coordinate detected by the first program code means and the second position coordinate detected by the second program code means. Computer readable, selecting one event type based on relationship And a computer-readable fourth program code means for executing a process corresponding to the type of event selected by the third program code means. Product. 34. A computer program product comprising a computer usable medium having computer readable program code means, said computer program product comprising a first input device having a pen input device in a first subspace area. Computer-readable first program code means for detecting the state of the first state, the first time of the first state, and the first position coordinate of the pen input device in the first state; and the first partial space area. A computer readable second program code means for detecting a second state in which a pen input device is inserted, a second time of the second state, and a second position coordinate of the pen input device in the second state. And a first time detected by the first program code means and a second time detected by the second program code means. If the time difference between the times is larger than the predetermined threshold time value, based on the relationship between the first position coordinate detected by the first program code means and the second position coordinate detected by the second program code means. Select one event type,
A computer comprising: a computer-readable third program code means; and a computer-readable fourth program code means for executing a process corresponding to the type of event selected by the third program code means. Program product. 35. A computer program product, comprising a computer usable medium having computer readable program code means, said computer program product having a pen input device in a first subspace area. A computer-readable first program code means for detecting the position coordinate of the pen input device in the state; and the pen input device outside a vicinity area of a predetermined size including the position coordinate detected by the first program code means. A computer-readable second program code means for counting the number of repetitions of the state in which the pen input device enters the neighborhood area of a predetermined size including the position coordinates detected by the first program code means after the exit. Second program code means coun Select one event type based on the number of repetitions
A computer comprising: a computer-readable second program code means; and a computer-readable third program code means for executing a process corresponding to the type of event selected by the third program code means. Program product. 36. A computer program product comprising a computer usable medium having computer readable program code means, the computer program product comprising a pen input device in a first sub-space region. Computer-readable first program code means for detecting the time of the state and the position coordinates of the pen input device in the state, and the outside of a predetermined area including a position coordinate detected by the first program code means. The first detected by the first program code means after the pen input device comes out.
A computer readable second program code means for counting the number of times of repeating the state in which the pen input device is placed in a vicinity area of a predetermined size including position coordinates within a predetermined time, and the second program code means. Select one event type based on the number of repetitions,
A computer comprising: a computer-readable third program code means; and a computer-readable fourth program code means for executing a process corresponding to the type of event selected by the third program code means. Program product.