JPH06131110A - Information processor - Google Patents

Abstract

PURPOSE:To speed up a gesture function when the gesture function is effective by providing a means which decides whether or not the gesture function is effective from pen-down coordinates where an input pen abuts on a tablet first at the time of the gesture function. CONSTITUTION:Respective coordinate data of drawing are detected in order by a track coordinate extraction part 21 which is connected to the tablet 19. At this time, the gesture decision part 22 for which the coordinate data from the track coordinate extraction part 21 are inputted decides whether or not the pen-down coordinates as XY coordinates that the input pen 12 abuts on the tablet 19 first among the coordinate data are in the effective area of the gesture function. Further, the gesture decision part 22 once deciding that the pen-down coordinates are effective sets the pen-down coordinates corresponding to each display screen of a display device 14 and decides whether or not the coordinates are in a pen button area where a choice is made with the input pen 12.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus such as a Japanese word processor having a function of editing a display screen with an input pen.

[0002]

2. Description of the Related Art In recent years, there has been provided a display device in which a display portion such as a liquid crystal display and a tablet for detecting coordinates of a contact portion with an input pen or the like are integrated, and it is set to be directly editable by the input pen. Information devices, so-called pen information input type information devices, have appeared on the market. Therefore, the display device can realize the same thing as the calibration with the manuscript paper on the tablet as if the paper and the pen were associated with each other. Sharp's Japanese word processor "WV-
S200 "etc. are known.

In these pen information input devices, a gesture function has been considered as a function for making the best use of its characteristics. Such a gesture function draws a character at a desired position on the tablet with an input pen by using an edit symbol that is set and stored in advance, and draws a sentence on the display device by using the edit symbol. It can be edited.

[0004]

However, in the above-mentioned conventional method, it is determined whether the gesture function by the input pen is valid or invalid after the pen-down at the start of drawing and after the pen-up at the completion of drawing is completed. , It took a long time to operate the gesture function. Further, in the above-mentioned conventional,
If the input pen passes through an area such as an icon, which is an invalid area of the gesture function during drawing, the gesture function is canceled. Therefore, in such a case, reset the settings again and draw on the tablet with the input pen. The problem is that it is necessary and time-consuming for the gesture function.

Further, in the above-described conventional art, for example, the user may unintentionally input an erasing or erasing type editing symbol to edit an unintended sentence, and it takes time to restore such a sentence. There is also a problem.

Further, in the above-mentioned conventional method, the trajectory of the input pen, the list of editing symbols, etc. can be displayed in order to effectively operate the gesture function. However, such deletion and display of the display are repeated. Then, there is a problem that the processing time becomes long and the processing speed becomes slow.

[0007]

In order to solve the above-mentioned problems, the information processing apparatus according to claim 1 of the present invention is provided with a display device such as a liquid crystal display, and an image is formed by drawing with an input pen. A gesture that can be used to input, or to indicate a desired position on the display surface of the display device is provided on the display surface, and an image such as an arrangement of characters and symbols on the display surface can be edited with the image. In an information processing apparatus having a function, a gesture valid area of the input pen in the gesture function and a gesture invalid area displaying an input function such as an icon prior to the gesture function are set in the tablet, and the gesture function is set. Sometimes the pen down coordinates, which are the coordinates where the input pen first touches the tablet, It is characterized by determining means and enable or disable the serial gesture function is provided.

Further, the information processing apparatus according to claim 2 is
In addition to the configuration according to claim 1, if the pen-down coordinate, which is the coordinate at which the input pen first contacts the tablet during the gesture function, is the gesture effective area, the input pen input after the pen-down coordinate. It is characterized in that stop means is provided for stopping the determination of the coordinates by the determination means.

An information processing apparatus according to claim 3 of the present invention is
A display device such as a liquid crystal display is provided, and a tablet capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device is provided on the display surface. In an information processing apparatus having a gesture function capable of editing an image such as an arrangement of characters and symbols on a surface with the image set in advance, a storage unit for storing the image in the gesture function is provided, and the storage unit It is characterized in that selection means for setting whether to enable or disable the calling of the image from the above is provided.

The information processing apparatus according to claim 4 is the information processing apparatus according to claim 3.
In addition to the configuration described above, it is further characterized in that a setting means for classifying the above-mentioned validity and invalidity and collectively setting the validity and invalidity is provided.

The information processing apparatus according to claim 5 is provided with a display device such as a liquid crystal display, and an image can be input by drawing with an input pen or a desired position on the display surface of the display device can be designated. In the information processing apparatus having a gesture function capable of editing an image of an arrangement of characters and symbols on the display surface with a tablet that can be provided on the display surface, the activation is performed when the gesture function is activated. It is characterized in that a storage area for storing image information showing an image on the display surface at the time is set.

[0012]

According to the structure described in claim 1, the determination means for determining the validity or invalidity of the gesture function based on the pen-down coordinate which is the coordinate at which the input pen first contacts the tablet during the gesture function. Is provided, it is possible to determine whether the gesture function is valid or invalid when the pen is down.

According to the above-mentioned structure, the stop means for stopping the determination by the determining means is provided during drawing with the input pen after pen down, so that it is effective during pen down. If so, for example, the gesture function is not invalidated even if the gesture invalid region is passed during the drawing.

According to the third aspect of the present invention, it is possible to set whether the image calling is valid or invalid.
For example, if the erasing type image is set to be called and disabled, it is possible to avoid the possibility that the erasing type image is called and the image is erroneously erased due to being unfamiliar with the operation, as is often seen by beginners.

According to the above-mentioned structure of the present invention, valid images and invalid images can be grouped and set collectively, so that, for example, an erase / delete image for beginners can be set. It can be set to invalid and only other valid images can be set at once, which simplifies such setting operations.

According to the above-mentioned structure of claim 5, since the original image information is stored in the storage area in advance at the time of editing by the gesture function, for example, as in the conventional case, at the time of editing by the gesture function, It is possible to save the trouble of displaying the image on the display surface, deleting the display, and then rearranging and displaying the original image information.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention is shown in FIGS.
The explanation is based on the following. In the information processing apparatus, as shown in the block diagram of FIG. 2, a central processing unit (Central Processing Unit, hereinafter referred to as CPU) 1 for executing a program is provided, and various data is stored in a bus line 18 of the CPU 1. R for reading
AM2, ROM3 for storing the control program, printer controller 4 for controlling the printer 5, and I for reading / writing the IC card 6 as the external storage means.
An FD controller 9 for controlling a C card interface 7 and a floppy disk drive (hereinafter referred to as FDD) 8 is connected.

Further, on the bus line 18, a key interface 11 for inputting a signal from the keyboard 10 as an input means to the bus line 18, and a display control for controlling a display device 14 such as a liquid crystal display. And 15 are connected.

Moreover, the bus line 18 is brought into contact with the image on the display device 14 to convert signals from the input pen 12 for inputting and selecting information into pen coordinates to convert the signals into pen coordinates. A pen interface 13 for inputting to a line 18 is connected, so that the input pen 12 has a so-called pointing function that shows on the image, or by drawing a predetermined image on the image, the input image is displayed on the image. It is an input means for the gesture function that allows selection of information and input of edit symbols.

A handwriting editing interface 16 is connected to the bus line 18, and the handwriting editing interface 16 will be described in detail later.
The recognition result of each coordinate data is output to the bus line 18 on the basis of the handwriting recognition dictionary (storage means) 17 which is a memory by the signal of each coordinate data indicating the pen coordinate from the input pen 12. It has become.

In the handwriting recognition dictionary 17, the basic strokes indicating characters and symbols are (1) horizontal writing gesture command table, (2) handwriting character table and (3) vertical writing gesture command table, which will be described later. They are stored according to their contents. As an example of such a basic stroke, an inverted L character, which is an edit symbol indicating a line feed, is 9 × 9 as shown in FIG.
It is shown by filling in the positions corresponding to each of the cells of the box, as indicated by the circles.

On the other hand, as shown in FIG.
4 is integrally formed with a transparent tablet 19 for detecting each coordinate of the screen, and the tablet 19 is a character array of the display device 14, for example, FIG.
As shown in FIG. 4 so as to correspond to the 40 vertical lines and 80 horizontal lines shown in FIG.
Each XY (640 × 400) coordinate is set in a grid pattern shown in (a).

As a result, the input pen 12 shown in FIG.
When the tip end of the tablet abuts on the tablet 19, the pen coordinates on the tablet 19 are detected by the pen interface 13, converted into a coordinate code, and output to the bus line 18.

Incidentally, as the above-mentioned tablet system,
It is not particularly limited as long as each coordinate of the locus can be detected when the input pen 12 comes into contact with and draws. And electromechanical tablets can also be used.

By using the above-mentioned structure, the display device 1
When a sentence is created on the keyboard 4, characters and symbols input from the keyboard 10 are converted into predetermined character codes and symbol codes by the key interface 11, and the respective codes are converted into the CPU 1 (the text editing unit in FIG. 1). 1
According to a), the data is temporarily stored in the RAM 2 (text memory 2a in FIG. 1).

Thereafter, the CPU 1 causes the display device 1 to execute the code stored in the RAM 2 based on the instruction from the keyboard 10 and the program stored in the ROM 3.
4 are arranged again on the RAM 2 so that they can be displayed on the screen (FIG.
Bitmap memory 2b). Then, the above RA
Each code array on M2 is displayed on the display device 14 via the display control 15.

Further, in the above configuration, the text once displayed on the display device 14 in this manner can be edited by the keyboard 10, the icon set on the display device 14, or an instruction by the input pen 12 described later, CPU1 above
RAM according to the prescribed program and the above instructions
Each code array of the bitmap memory 2b in 2 can be rearranged, that is, edited.

Next, the gesture function for facilitating the editing of the text displayed on the display device 14 will be described. First, as shown in FIG. 1, on a display tablet 20 in which a display device 14 such as a CRT or a liquid crystal and a transparent tablet 19 provided on the display surface thereof are integrally formed. An image showing, for example, an edit symbol is drawn with the input pen 12 at a desired position of an image such as a displayed text.

Each coordinate data of such drawing is sequentially detected by the locus coordinate extracting section 21 connected to the tablet 19. At this time, in the coordinate data, the XY with which the input pen 12 and the tablet 19 first come into contact with each other.
The pen-down coordinates that are the coordinates are the tablet 1 shown in FIG.
The locus coordinate extraction unit 2 determines whether the gesture function effective area 19a in FIG.
It is determined by the gesture determination unit (determination means) 22 to which the coordinate data from 1 is input.

Further, when the gesture determining section 22 determines that the pen-down coordinates are valid, the pen-down coordinates are set according to each display screen of the display device 14, and selected by the input pen 12. Is determined to be a pen button area.

After that, when it is determined that the pen-down coordinate is within the effective area and is not the pen button area, the trajectory determining section 23 to which the coordinate data is input from the gesture determining section 22 determines whether the gesture function of the gesture function. A gesture function ON flag indicating ON is set in the flag instruction unit (stop means) 24.

When the gesture function ON flag is set in the flag instructing section 24, the coordinate data buffer 25 connected to the trajectory determining section 23, including the pen-down coordinates, is used for each coordinate data indicating the drawing trajectory. Are sequentially stored in each.

In addition, when the gesture function ON flag is set in the flag designating section 24, the gesture determining section 22 determines whether the input coordinate data is within the valid area and whether or not the coordinate data is in the pen button area. The determination as to whether there is any is stopped, and all the input coordinate data are validated and output to the trajectory determination unit 23.

When the drawing by the input pen 12 is completed and the input pen 12 is in a pen-up state in which the input pen 12 is separated from the tablet 19, the locus determination unit 23 confirms that the gesture function ON flag is set. Then, all of the trajectory coordinate data are output from the data buffer 25 to the gesture command determination unit 26.

When all the coordinate data are output to the gesture command determination unit 26 as described above, the gesture function ON flag by the flag instruction unit 24 is reset.

The trajectory coordinate data is collated with the basic stroke data which is normalized by the gesture command determination unit 26 and stored in the gesture command table 27 included in the handwriting recognition dictionary 17 shown in FIG. To be done. The gesture command determination unit 27 is included in the handwriting editing interface 16, and the trajectory coordinate extraction unit 21, gesture determination unit 22, trajectory determination unit 23, and flag instruction unit 24 are included.
Is included in the pen interface 13 described above,
The coordinate data buffer 25 has a storage area set in the RAM 2.

The above-mentioned gesture command table 27
In addition to the basic strokes corresponding to the one-character deletion command 27a, the space insertion command 27b, and the handwritten character input command 27c shown in FIG.
A plurality of basic strokes shown in are stored together with the corresponding commands.

A command selecting section (selecting means) 3 which can set each basic stroke in the gesture command table 27 by the gesture command judging section 26 by selecting whether it is accessible or not.
2 is provided, and the selection by the command selection section 32 can be set by the input means such as the input pen 12 and the keyboard 10 via the text editing section 1a.

In the command selecting section 32, each basic stroke is individually identified by the gesture command determining section 26.
From the above, it is possible to selectively set accessible and inaccessible. Also, by grouping the above basic strokes, it is possible to selectively set (accessible) and inaccessible for each group. Has become.

Further, a registration buffer 33 for storing the table indicating the accessibility and inaccessibility of each command corresponding to each of the above basic strokes and calling the table arbitrarily and displaying it on the display device 14 is provided. It is provided. Further, in the registration buffer 33, when grouping is performed in the command selecting unit 32, a grouping table can be stored so that, for example, all invalid, some valid, and all valid can be selected.

The above-mentioned gesture command determination unit 27
Outputs a command corresponding to the basic stroke closest to the above-mentioned locus coordinates to the text editing unit 1a as a result of collation with each of the above basic strokes, and is processed by the above command from the locus coordinates supplied. The coordinate information of the character or the character string, that is, the position information on the display device 14 is output to the text editing unit 1a.

As a result, the text editing section 1a is
The character or symbol of the above-mentioned position information in the array of characters or symbols in the text memory 2a can be edited by deleting it or inserting it at that position. At this time, the text editing unit 1a displays the text memory 2a displayed on the display device 14 when the gesture function as described above is activated, that is, immediately before the input operation by the input pen 12 is started.
A screen information buffer (storage area) 31 which is a memory for calling and temporarily storing the screen information therein is set. In the screen information buffer 31, when the next screen information is stored, the previously stored screen information is cleared.

As a result, since the previous screen information is stored in advance when canceling the above-mentioned editing, for example, as shown in FIG. 17, the locus display of the input pen 12, the rectangular display of the recognition area, and the recognition information are displayed. Even if a display, a list of recognition displays, a message asking whether to cancel the processing result, or the like is displayed, the redisplay of the editing screen, the recognition function execution, the cancellation of the editing processing, and the like can be speeded up.

The text editing unit 1a receives not only the command from the gesture command determining unit 27 but also the command from the keyboard 10 as described above, and edits by the command. You can do it.

On the other hand, the locus coordinate data extracted by the locus coordinate extraction unit 21 independently of the above locus coordinate processing is output to the locus drawing unit 28 to form a locus image in which the above locus coordinate data are connected. .

The generated trajectory image is combined with the character string, symbol string or image currently formed in the bit map memory 2b and stored in the bit map memory 2b. Therefore, the operator can
Then, the gesture image input by tracing the tablet 19 is displayed on the display device 14 in real time.

An example of such a gesture editing operation is shown in FIGS. 8 and 9. First, in FIG. 8, when erasing one character “e” in the text displayed on the display tablet 20, the input pen 12 makes a gesture like “V” on the character “e”, That is, after drawing, the input pen 12 is moved to the display tablet 20.
Separate from the top.

In the above drawing, it is important for recognizing the above character that the starting position is within the range of the above character. In particular, it is desirable to start drawing from substantially the central portion of the above character in order to facilitate recognition of the designated character.

Subsequently, the locus coordinates are extracted, the locus image is displayed on the display device 14 of the display tablet 20, and a single character corresponding to the drawing of "V" obtained by collation with the basic stroke is erased. Along with the command, the position information of the character "e" is output to the text editing unit 1a.

Thereafter, based on the above position information, the cursor 14a on the display device 14 is moved from the original position, for example, the position of the character "HO" to the position operated by the input pen 12, that is, the character "E" in the above case. After moving to the position
By deleting the "e" in the text memory 2a based on the command, the character "e" in the bitmap memory 2b is erased, and the "e" in the display device 14 is deleted. Is erased. In this way, the gesture editing is completed.

As shown in FIG. 9, the display tablet 20 is provided with an input pen (not shown) for each edit symbol.
By drawing on the above, it is possible to edit the gesture as described above. The basic stroke, which is the image of the above-mentioned edit symbol, can be arbitrarily set.

Next, the pointing function with the above configuration will be described. First, in the conventional word processor, the cursor is sequentially moved when designating a plurality of characters on the text, but in the above configuration, the position of the cursor 14a is directly instructed by the direct input pen 12. It is possible.

The switching between the gesture and the pointing is determined by whether or not the extracted coordinates are the coordinates of one point without a locus, that is, whether or not the above coordinates are continuous. Such a determination is made by the trajectory determination unit 23.

Therefore, for example, when it is determined to be pointing, the obtained coordinates are not collated with the gesture command table 27, and only the position information of the coordinates is output to the text editing section 1a. An example of operation of such a pointing function is as shown in FIG.

Next, the input of handwritten characters will be described using the above configuration. The input of handwritten characters can be executed by the same processing method as the above-mentioned gesture editing in which the trajectory coordinates are collated with the basic strokes stored in advance.

That is, as shown in FIG. 1, the handwritten character recognizing unit 2 is provided at the same processing position as the gesture command determining unit 26, that is, in the handwriting editing interface 16.
9 is formed and the handwritten character table 30 storing handwritten characters in advance is the gesture command table 27.
The handwriting recognition dictionary 17 shown in FIG.

The handwritten character recognition unit 29 collates the locus coordinates supplied from the locus coordinate extraction unit 21 with a plurality of basic character strokes stored in the handwritten character table 30 to obtain the most similar basic character stroke. The character code corresponding to is output from the handwritten character table 30 to the text editing unit 1a.

The difference between such a handwritten character input function and the above-mentioned gesture editing function is that the handwritten character recognition unit 29 does not output position information. The handwriting character input function described above can be activated by an instruction from the keyboard 10 or an icon from the display device 14, and as shown in FIG. 6 on the tablet 19 of the display tablet 20. By gesturing "△", it is possible to launch from the gesture editing function.

An example of the operation of the handwritten character input function will be described. As shown in FIG. 11, when the handwritten character input function is activated, the display tablet 2 is activated.
Window 1 for inputting handwritten characters at a predetermined position of 0
4b is displayed, and in the first input area in the window 14a, a character is handwritten with the input pen 12, for example, "su".

After that, when the input pen 12 is brought into contact with the adjacent second area for the next input, at that time, the above first
Character recognition of the locus coordinates handwritten in the area is executed as described above by the handwritten character recognition unit 29 with reference to the handwritten character table 30, and the character of the recognition result is input to the position indicated by the cursor 14a. It is designed to be displayed.

Thus, for example, a font such as a cursive font is stored in the handwritten character table 30 in advance, and the cursive font is input by handwriting, and the handwritten character table 30 is entered.
It is possible to display and print cursive fonts in.

Next, an operation example of the above configuration in the gesture editing function will be described with reference to the flowchart of FIG. 12. First, the tip portion of the input pen 12 abuts or presses at a desired position on the display tablet 20, That is, when down, the coordinates at that time are shown via the pen interface 13.

On the other hand, the function of the input pen 12 in the icon area and the pen button area of the display device 14 is a selection function. Therefore, the effective range of the above-described gesture editing function on the display tablet 20 is the tablet 19 area excluding the above areas.

Therefore, in the tablet 19 of the display tablet 20, for example, as shown in FIG. 13, the effective area 19a and the gesture function of the tablet 19 are set in advance in accordance with each screen used in the display tablet 20. For example, an invalid area 19b indicating a priority icon area and a pen button area 19c prioritizing the gesture function are set.

Therefore, when the pen down is executed as described above and the coordinate data signal is output to the locus coordinate extracting section 21, first, the pen down coordinate which is the contact coordinate of the first input pen 12 is detected ( Step 1, hereinafter step is abbreviated as S), and the effective area coordinates are compared (S).
2) As a result, if the pen-down coordinates are outside the effective area coordinates, the gesture function becomes invalid and the gesture function ends.

If the pen-down coordinates are within the effective area coordinates, the next step is to determine whether or not the pen button area, which is one of the other factors for prohibiting the gesture function, is in the pen-down coordinates. If it is detected (S3) and the pen-down coordinates are on the coordinates of the pen button area, the routine moves to the routine for pen button processing (S3).
4).

On the other hand, if the pen-down coordinate is outside the coordinates of the pen button area, the pen-down coordinate is stored, and when the next coordinate data is input by the input pen 12, the coordinate data and the pen-down coordinate are input. Comparing the coordinates, the input coordinates are continuous with the pen down coordinates,
That is, it is determined whether at least one of the X coordinate and the Y coordinate is continuous for 8 coordinates (S5).

At this time, if each of the coordinate data is a continuous trajectory, the gesture function is turned on, the gesture ON flag is set (S6), and the input pen 1
Even if 2 passes outside the effective area of the gesture function, that is, passes through the icon area or the like, the icon pointing function of the input pen 12 in the icon area is stopped. If the determination in S5 is not a continuous trajectory, the process proceeds to the pointing process routine (S7).

The above steps S5 and S6 are reversed,
That is, the gesture ON flag may be set first. In this case, when each coordinate data is not continuous, the process goes to the pointing process routine, and the gesture ON flag is reset at that time.

Thereafter, a gesture operation, that is, an operation of inputting a predetermined image on the tablet 19 by the input pen 12, is performed, and the contact between the input pen 12 and the tablet 19 is released, that is, the input pen 12 is moved up. When,
As shown in the flowchart of FIG. 14, first, it is determined whether or not the flag indicating that the gesture function is ON is set as described above (S11), and if the flag is not set, the above is set. The input operation is determined to be an operation unrelated to the gesture function, and the gesture function ends.

If the above flag is set,
The gesture command determination unit 26 first normalizes and stores each coordinate data of the input pen 12 from the pen-down coordinate to the pen-up coordinate for the recognition process in a dedicated coordinate data memory (S12).

Next, the recognition processing of each coordinate data is executed by the gesture command determination unit 26 (S13),
Subsequently, if the recognition is OK in comparison with the gesture command table 27 (S14), each editing process according to the recognition result is executed (S15), and the gesture editing is completed. If the recognition process is not possible, the process moves to the error process (S16) to end the gesture editing.

As described above, in the configuration of the above embodiment, when pen-up is performed, even if the pen coordinate at that time is outside the effective area of the gesture function, if the gesture function is ON at that time, gesture recognition is performed. If the pen-down coordinates are within the valid area and outside the pen button area, the coordinates of the drawing locus following the pen-down coordinates are outside the valid area and the pen button area. Within this, the coordinate data of the drawing locus can be validated and the recognition processing can be shifted to.

Therefore, in the above configuration, for example, as shown in FIG. 15, when the input pen (not shown) is downed at the point A, since the point A is within the gesture effective area 19a, the input pen after the down transition. Even if the gesture function by the drawing is turned on and the drawing by the input pen is completed and the up coordinate of the input pen becomes the point B, and the point B is outside the gesture effective area 19a, that is, the invalid area 19b, Drawing, that is, the gesture is effective. The same applies when each coordinate in the middle of the drawing trajectory becomes the invalid area 19b.

However, the above-mentioned configuration is, for example, as shown in FIG. 16, outside the gesture effective area, that is, ineffective area 1.
When a not-shown input pen is moved down at a point C within 9a, the operation with the input pen is performed by the gesture function O.
It becomes FF and shifts to, for example, icon processing.

By the way, in the conventional gesture function, since it is determined whether or not the drawing is effective after the drawing is completed, it takes time to make the determination, and the input as described above is performed. If the input pen comes into contact with an invalid area outside the valid gesture area or a tablet area that is the pen button area during drawing with the pen, the processing of that gesture function is stopped and error processing is entered. It was

Therefore, in the above-mentioned conventional technique, it is necessary to pay attention to the operation of the input pen not only at the start of the operation but also at the operation until the operation is completed, and it takes time to draw the gesture function and the operability is deteriorated. .

However, in the configuration of the above-described embodiment, if the pen-down coordinate by the input pen 12 is within the effective area 19a of the gesture function, the gesture function is started, and the input pen 12 moves during the drawing by the input pen 12. Even when the gesture is outside the effective area 19a, that is, when the gesture area is in contact with the invalid area 19b or the pen button area 19c, the drawing is valid.

With the above arrangement, since the gesture function can be started by the pen-down coordinates, it is possible to prepare in advance a call to the gesture command table 27, etc., which is necessary for the gesture function, so that the gesture function can be accelerated. Is possible, and on top of that,
During the drawing by the input pen 12, it is not necessary to pay particular attention to the effective area, and the operability of the gesture function can be improved.

Next, each operation at the time of the command selecting function in the gesture function will be described with reference to the flowchart of FIG. When the processing of the command selection function is activated by an instruction signal from the input means such as the keyboard 10, first, the processing function names of all recognizable commands are called (S21), and then the processing function names are changed. It is displayed on the display device 14 as a table item (S
22).

Then, after selecting valid / invalid for each item by the execution key on the keyboard 10 (S2
3), whether or not the valid / invalid command is updated by key operation is set, for example, as shown in FIG. 19 (S24). At this time, when updating to the newly selected valid / invalid command, the execution key is turned on, the above selection data is fetched (S25), updated (S26), and the screen on the display device 14 is cleared ( S27), when the above process is completed and the newly selected valid / invalid command is not updated, the release key is turned on and the update is not performed, and the screen on the display device 14 is cleared (S27). The process ends.

Next, each operation in the registration / calling processing in the command selection function will be described with reference to the flowchart of FIG. First, when the above registration / calling process is activated by an instruction signal from an input means such as the input pen 12 or the keyboard 10, it is first determined whether it is a registration process or a calling process (S31). After calling all of the current valid / invalid command data on the display device 14 (S32) and confirming them, enter the registration name from the keyboard 10 or the like (S33), and register the valid / invalid command data with the registration mate. Buffer 3
3 (S34), and the registration process is completed.

On the other hand, in the case of the calling process in S31, after inputting and selecting the registered name (S35), the registered name in the registration buffer 33 is searched (S36), and the valid / invalid corresponding to the registered name is searched. The command data is called and displayed on the display device 14 (S37), the valid / invalid command data up to that point is updated to the valid / invalid command data of the registered name (S38), and the calling process is completed.

As described above, in the configuration of the above embodiment, it is possible to set valid and invalid for each command, so that the gesture function required by the user can be validated. As a result, it is possible to prevent an erroneous operation due to unnecessary recognition of the gesture function, and it is possible to reduce the number of gesture commands recognized by the user, so that the user recognition rate of commands can be increased.

Therefore, the above configuration can reduce erroneous recognition of each command used for the gesture function and enable more accurate editing processing according to the user's intention.

Further, in the above configuration, when a plurality of users use the same information processing apparatus or the like, command validity / invalidity is selected for each user and the selected content is stored, that is, registered. You can This allows
A gesture function required by each of a plurality of users can be arbitrarily selected at any time, and an editing process suitable for an editing method of each user can be easily performed.

In addition, the above-mentioned configuration creates sentences and the like resulting from careless editing by the unnecessary gesture function when the gesture function required for each user is changed every time the user changes. You can reduce the time and effort.

Next, the mode selection processing by the valid / invalid grouping in the command selection function will be described with reference to FIG. When the above-described configuration is in the gesture function and an interrupt is generated by the mode selection key with the keyboard 10, the input pen 12, etc., first, the processing function names of all recognizable commands are called, and then the processing function names are changed. The items of the table are displayed on the display device 14 (S41).

Next, after selecting valid / invalid for each item by the execution key on the keyboard 10 and setting the valid command group and the invalid command group (S
42), whether or not to update the valid / invalid command up to now to the command selected as described above is set by key operation (S43).

At this time, in the case of updating to the newly selected valid / invalid command, the execution key is turned on and the above selection data is fetched and updated (S44).
4 clears the screen (S45) and completes the mode selection process. On the other hand, if the newly selected valid / invalid command is not updated, the release key is not turned on to update the display device 14. Clear the screen (S4
5) Then, the mode selection process ends.

As described above, in the above configuration, since the invalid command in the gesture function can be set, it is possible to prevent erroneous recognition of the gesture command in the gesture function as described above.

In addition, in the above configuration, for example, the gesture edit can be enabled by setting the erase / delete command to be invalid and the other commands to be valid. It is possible to avoid the possibility that an image such as a sentence in erroneously deleted. An example of such a partially effective gesture function selection screen is shown in FIG.
Shown in 1.

In this way, since partial activation can be selected, the effect of preventing a beginner who handles a gesture function from accidentally erasing an image such as a sentence on the display device 14 is particularly great, and the above-described configuration is operated. It is possible to save the trouble of re-creating a sentence or the like due to a mistake at the time and improve the operability.

In addition, the above-mentioned configuration has the screen information buffer 31.
As shown in the flowchart of FIG. 23, when the gesture function is activated, the image information on the display device 14 at that time is stored in the screen information buffer 31, that is, saved (S51).

Then, the input pen 12 is moved down (S
52) When the command for instructing the editing function is input by the input pen 12 (S53), the recognition of the editing range is confirmed (S54, S55), and when the input pen 12 moves up (S52), the command and The edit range is output to the gesture command determination unit 26 (S56).

Then, the screen information saved in the screen information buffer 31 is returned to the display screen (S57). Subsequently, a function such as an editing operation is executed on the screen information stored in the text memory 2a, and the result is displayed on the display device 14 (S
58).

Next, it is determined whether or not the display screen of the display device 14 is to be canceled (S59). If not canceled, the above-mentioned gesture function is completed, and if canceled, it is saved in the screen information buffer 31. The display screen of the display device 14 is returned to the displayed screen information, and the screen information in the text memory 2a is also returned to the original screen information (S60).

As described above, in the above configuration, the image information on the display device 14 immediately before the operation with the input pen 12 of the gesture function is stored in the screen information buffer 31, so that the gesture function is canceled as described above. , It is possible to speed up the restoration to the original image.

[0099]

As described above, the information processing apparatus according to claim 1 of the present invention displays the gesture effective area of the input pen in the gesture function and the input function such as an icon prior to the gesture function. A gesture invalid area is set in the tablet, and a determination unit is provided to determine whether the gesture function is valid or invalid based on the pen-down coordinate which is the coordinate at which the input pen first contacts the tablet during the gesture function. It has a structure.

Therefore, the above-described structure can determine whether the gesture function is valid or invalid at the time of pen down, so that it is possible to accelerate the gesture function when the gesture function is valid.

The information processing apparatus according to claim 2 of the present invention is
Further, if the pen-down coordinates, which are the coordinates at which the input pen first contacts the tablet during the gesture function, are the gesture effective area, the coordinates of the input pen input after the pen-down coordinates are determined by the determination means. This is a configuration in which stop means for stopping the determination is provided.

Therefore, in the above configuration, the gesture function is not invalidated even if it passes through the gesture invalidation area while drawing an arbitrary position on the tablet with the input pen, and the gesture function is invalidated as in the conventional case. As a result, it is possible to save the trouble of drawing again with the input pen.

An information processing apparatus according to claim 3 of the present invention is
As described above, the storage means for storing the image in the gesture function is provided, and the selection means for setting the validity or invalidity of the calling of the image from the storage means is provided.

Therefore, with the above configuration, it is possible to set whether the image recall is valid or invalid. Therefore, for example, if the erase type image is recalled invalid, it is unfamiliar to the operation, as often seen by beginners. Therefore, it is possible to avoid the risk of accidentally erasing an image by calling an erasing system image. This brings about an effect that it is possible to avoid the conventional inconvenience that it takes time to restore the image.

An information processing apparatus according to claim 4 of the present invention is
Further, in addition to the configuration according to claim 3, a configuration is provided in which the validity and invalidity of the gesture function are classified and a setting means for collectively setting the validity and invalidity is provided.

Therefore, in the above-mentioned configuration, valid images and invalid images can be grouped and set collectively, so that, for example, for beginners, the erase / delete image is set invalid. Every other valid image can be set in a lump, which simplifies such setting operations.In addition, as is often seen by beginners, it is unfamiliar with the operation, so erase type images There is an effect that it is possible to avoid the possibility of calling and erasing an image by mistake, and avoiding the conventional inconvenience that it takes time to restore the image.

An information processing apparatus according to claim 5 of the present invention is
As described above, a display device such as a liquid crystal display is provided, and a tablet capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device is provided on the display surface. In an information processing apparatus provided with a gesture function capable of editing an image such as an arrangement of characters and symbols on the display surface with the image, when the gesture function is activated, an image on the display surface at the time of activation is displayed. The configuration is such that a storage area for storing the indicated image information is set.

Therefore, in the above configuration, since the original image information is stored in the storage area in advance at the time of editing by the gesture function, for example, the image is displayed at the time of editing as in the conventional case, and the display is performed. It is possible to save the trouble of arranging and displaying the image information again after erasing, and it is possible to speed up the restoration of the image at the time of editing by the gesture function.

[Brief description of drawings]

FIG. 1 is a block diagram of a main part of an information processing apparatus of the present invention.

FIG. 2 is a block diagram of the information processing device.

FIG. 3 is an explanatory diagram showing an example of recognition of basic strokes in the information processing apparatus.

4A and 4B are explanatory diagrams showing position information on the display tablet of the information processing apparatus, wherein FIG. 4A is a tablet and FIG. 4B is a display surface of the display device.

FIG. 5 is an explanatory diagram showing a gesture function valid area and a gesture function invalid area in the display tablet.

FIG. 6 is an explanatory diagram showing examples of the basic strokes and commands corresponding to the examples.

FIG. 7 is an explanatory diagram showing examples of the basic strokes and commands corresponding to the examples.

FIG. 8 is an explanatory diagram showing an example of an editing operation of a gesture function in the above information processing device.

FIG. 9 is an explanatory diagram showing an example of each editing operation of the gesture function in the information processing apparatus.

FIG. 10 is an explanatory diagram showing an operation example of a pointing function in the information processing apparatus.

FIG. 11 is an explanatory diagram showing an operation example of a handwritten character input function in the information processing apparatus.

FIG. 12 is a flowchart at the time of pen down in the above gesture function.

FIG. 13 is an explanatory diagram showing a pen button area in the display tablet.

FIG. 14 is a flowchart at the time of pen-up in the above gesture function.

FIG. 15 is an explanatory diagram showing an example of a locus on the display tablet in the above gesture function.

FIG. 16 is an explanatory diagram showing an example of another locus on the display tablet in the gesture function.

FIG. 17 is an explanatory diagram showing a display example on the display tablet in the gesture function.

FIG. 18 is a flowchart for setting the validity / invalidity of the call in the above-mentioned gesture function.

FIG. 19 is an explanatory diagram showing a display example on the display device when setting the validity / invalidity of the call in the gesture function.

FIG. 20 is a flowchart for setting registration / calling in the above gesture function.

FIG. 21 is a flowchart for setting a mode in the above gesture function.

FIG. 22 is an explanatory diagram showing a display example on the display device when the above mode is selected.

FIG. 23 is a flowchart showing a method of saving image information in the above gesture function.

[Explanation of symbols]

 12 input pen 14 display device 19 tablet 22 gesture determination section (determination means)

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Hiroyuki Nagasawa 22-22 Nagaike-cho, Abeno-ku, Osaka-shi, Osaka Within Sharp Corporation (72) Hiroshi Nakao 22-22 Nagaike-cho, Abeno-ku, Osaka-shi, Osaka (72) Inventor Yasuhiro Nakajima 22-22 Nagaike-cho, Abeno-ku, Osaka-shi, Osaka Inside Sharp Corporation (72) In-house Masaaki Kurata 22-22 Nagaike-cho, Abeno-ku, Osaka, Osaka Inside Sharp Corporation

Claims (5)

[Claims] 1. A tablet provided with a display device such as a liquid crystal display and capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device is provided on the display surface. In an information processing device provided with a gesture function capable of editing an image such as an arrangement of characters and symbols on the display surface with the image, a gesture effective area of the input pen in the gesture function and the gesture function have priority. A gesture invalid area displaying an input function such as an icon is set in the tablet, and the gesture function is enabled by the pen-down coordinate which is the coordinate at which the input pen first contacts the tablet during the gesture function. It is characterized in that a determination means for determining invalidity is provided. Information processing equipment. 2. A tablet, which is provided with a display device such as a liquid crystal display, is capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device. In an information processing device provided with a gesture function capable of editing an image such as an arrangement of characters and symbols on the display surface with the image, a gesture effective area of the input pen in the gesture function and the gesture function have priority. A gesture invalid area displaying an input function such as an icon is set on the tablet, and the coordinates of the input pen contacting the tablet during the gesture function,
If the determination means for determining whether the gesture function is valid or invalid is provided, and the pen-down coordinate, which is the coordinate at which the input pen first contacts the tablet during the gesture function, is the gesture valid area, the pen-down is performed. An information processing apparatus, comprising: a stop means for stopping the determination of the coordinates of the input pen input after the coordinates by the determination means. 3. A tablet, which is provided with a display device such as a liquid crystal display, is capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device. In an information processing apparatus having a gesture function, which is provided and is capable of editing an image such as an arrangement of characters and symbols on the display surface with the image set in advance, storage means for storing the image in the gesture function is provided. An information processing apparatus, further comprising: a selection unit that sets validity and invalidity of calling the image from the storage unit. 4. A tablet, which is provided with a display device such as a liquid crystal display, is capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device. In an information processing device provided with a gesture function capable of editing an image such as an arrangement of characters and symbols on the display surface with the image set in advance, a storage unit for storing a plurality of the images in the gesture function is provided. Selection means for setting the validity and invalidity of the calling of the image, respectively, and a setting means for grouping the validity and invalidity and collectively setting the validity and invalidity. An information processing device characterized in that. 5. A display device such as a liquid crystal display is provided, and a tablet is provided on the display screen for inputting an image by drawing with an input pen and designating a desired position on the display screen of the display device. In an information processing device provided with a gesture function capable of editing an image such as an arrangement of characters and symbols on the display surface with the image, when the gesture function is activated, an image on the display surface at the time of activation is displayed. An information processing apparatus, wherein a storage area for storing image information is set.