JPH06149466A - Information processor - Google Patents

Abstract

PURPOSE:To accelerate a restoration processing at the time of restoring original pictures at an erroneous editing processing or the like by setting a storage area for storing picture information for indicating pictures and a work flag for indicating the operational conditions of respective functions. CONSTITUTION:A display device 14 such as a liquid crystal display or the like is provided and a tablet 19 capable of inputting images by plotting them by an input pen 12 and instructing a desired position 6n the display screen of the display device is provided on the display screen. A gesture function capable of editing the pictures such as the arrays of symbols and characters on the display screen by the images is provided and a screen information buffer 31 for storing the picture information for indicating the pictures on the display screen at the time of starting and the work flag for indicating the operational conditions of the respective functions when the gesture function is started is set. Then, at the time of editing by the gesture function, since the original picture information is stored in the screen information buffer 31 beforehand, the picture information is called and the original pictures before the editing by the gesture function can be restored.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus such as a Japanese word processor having a function of editing a display screen with an input pen.

[0002]

2. Description of the Related Art In recent years, there has been provided a display device in which a display portion such as a liquid crystal display and a tablet for detecting coordinates of a contact portion with an input pen or the like are integrated, and it is set to be directly editable by the input pen. Information devices, so-called pen information input type information devices, have appeared on the market. Therefore, the display device can realize the same thing as the calibration with the manuscript paper on the tablet as if the paper and the pen were associated with each other. Sharp's Japanese word processor "WV-
S200 "etc. are known.

In these pen information input devices, a gesture function has been considered as a function for making the best use of its characteristics. Such a gesture function draws a character at a desired position on the tablet with an input pen by using an edit symbol that is set and stored in advance, and draws a sentence on the display device by using the edit symbol. It can be edited directly.

Therefore, in the above pen information input device,
The basic stroke corresponding to each editing function is stored in advance as a gesture command table, and the image input using the input pen and the tablet is compared with each of the above basic strokes, and the image matches within the predetermined range. The editing function corresponding to the image is detected from the basic stroke.

[0005]

However, in the above-mentioned pen information input device, in the case of an editing function for processing a large amount of character strings such as partial erasing, moving, copying, underlining and space insertion, such Even if an attempt is made to return to the original state before editing after the function is executed, it is not always possible to return to the original state. Even if the original state can be restored, the operation status such as the work flag is often changed during or after the edit operation, and the reset operation is performed because the settings are reset. Becomes complicated, and there is a problem that the restoration operation is troublesome.

Further, in the above-mentioned pen information input device, if an editing function by a gesture function is added to not only conventional horizontal writing but also vertical writing, the writing of horizontal writing and vertical writing is not performed. The editing symbols are often different, and the commands stored in the gesture command table and the corresponding basic strokes increase. As a result, by comparing with the input image,
There is also a problem that the detection process of the corresponding commands is time-consuming and the processing time is increased, and that the number of basic strokes stored by the user is increased, so that the recognition rate thereof is decreased.

[0007]

In order to solve the above-mentioned problems, the information processing apparatus according to claim 1 of the present invention is provided with a display device such as a liquid crystal display, and an image is formed by drawing with an input pen. A gesture that can be used to input, or to indicate a desired position on the display surface of the display device is provided on the display surface, and an image such as an arrangement of characters and symbols on the display surface can be edited with the image. In an information processing apparatus having a function, when the gesture function is activated, a storage area for storing image information indicating an image on the display surface at the time of activation and a work flag indicating an operation status of each function is set. It is characterized by being.

An information processing apparatus according to claim 2 of the present invention is
A tablet that is provided with a display device such as a liquid crystal display that displays an image of an arrangement of characters and symbols, and that can input an image by drawing with an input pen and can indicate a desired position on the display surface of the display device. Is provided on the display surface, and storage means for storing in advance a command for editing the image and a basic image corresponding to the command is provided, and is called from the image for editing and the storage means. In the information processing apparatus having a gesture function of selecting the command corresponding to the image by comparing the basic image with the basic image and editing the image with the command, a horizontal writing command for editing images arranged side by side and its horizontal writing The horizontal writing storage area for storing the horizontal writing basic image corresponding to the command is provided in the storage means. Further, a vertical writing storage area for storing a vertical writing command for editing vertically aligned images and a vertical writing basic image corresponding to the vertical writing command is provided in the storage means, and the horizontal writing storage area is provided. It is characterized in that selection means for selecting either one of the vertical writing storage area and the vertical writing storage area is provided.

An information processing apparatus according to claim 3 of the present invention is
A tablet that is provided with a display device such as a liquid crystal display that displays an image of an arrangement of characters and symbols, and that can input an image by drawing with an input pen and can indicate a desired position on the display surface of the display device. Is provided on the display surface, and storage means for storing in advance a command for editing the image and a basic image corresponding to the command is provided, and is called from the image for editing and the storage means. In the information processing apparatus having a gesture function of selecting the command corresponding to the image by comparing the basic image with the basic image and editing the image with the command, the basic image is used for both vertical writing and horizontal writing. Common basic image common to all, and a convertible basic image that can be converted between vertical writing and horizontal writing. A conversion means is provided for converting the convertible basic image stored as one of the vertical writing vertical basic images to the other based on a signal indicating the other horizontal writing or vertical writing. I am trying.

[0010]

According to the configuration of the above-mentioned claim 1, since the original image information is stored in the storage area in advance at the time of editing by the gesture function. Editing the image information in the above storage area by saving the trouble of displaying the image on the display surface and deleting the display and then arranging and displaying the original image information again. You can revert to the original image that was before.

In addition, in the above configuration, since the work flag indicating the operation status before the editing by the gesture function is also stored, even if the work flag is changed by the editing operation, the work flag is reset. It is possible to return to the original work flag, that is, to return to the original operation status, by omitting the trouble of.

According to the second aspect of the present invention, since the horizontal writing storage area for storing the horizontal writing basic image and the vertical writing storage area for storing the vertical writing basic image are provided, the gesture With the function, it is possible to edit horizontally written sentences and vertically written sentences.

In addition, since the above-mentioned configuration is provided with the selection means, when an image is input, it is compared with the basic image of one of the horizontal writing storage area and the vertical writing storage area. do it.

According to the third aspect of the present invention, since the basic image and the conversion means are provided, it is possible to edit a horizontally written sentence and a vertically written sentence by the gesture function.

Further, by providing the converting means, a convertible basic image that can be used in common can be set, so that the number of basic images in the storage means can be reduced and the storage area of the storage means can be reduced. It becomes easy to secure a memory range for application programs and the like.

In addition, in the above-described configuration, in a command that can edit a horizontally written sentence and a vertically written sentence, the convertible basic images that can both be used can be mutually converted, so that the commonly used conversion is also possible. The basic image is
It can be set so that they have similarities to each other and can be easily recognized.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following will describe one embodiment of the present invention as Embodiment 1 with reference to FIGS. [Embodiment 1] In an information processing apparatus, as shown in the block diagram of FIG. 2, a central processing unit (Centra) that executes a program is used.
l Proccesing Unit (hereinafter referred to as CPU) 1 is provided, and a bus line 18 of the CPU 1 has a RAM 2 for storing and reading various data, a ROM 3 for storing a control program, and a printer controller 4 for controlling the printer 5. , An IC card interface 7 for reading and writing to the IC card 6 as external storage means,
Also, an FD controller 9 for controlling a floppy disk drive (hereinafter referred to as FDD) 8 is connected.

Further, on the bus line 18, a key interface 11 for inputting a signal from the keyboard 10 as an input means to the bus line 18, and a display control for controlling a display device 14 such as a liquid crystal display. And 15 are connected.

Moreover, the bus line 18 is brought into contact with the image on the display device 14 to convert signals from the input pen 12 for inputting and selecting information into pen coordinates to convert the signals into pen coordinates. A pen interface 13 for inputting to a line 18 is connected, so that the input pen 12 has a so-called pointing function which shows on the image, or draws a predetermined image on the image to display on the image. It is an input means for the gesture function that allows selection of information and input of edit symbols.

A handwriting editing interface 16 is connected to the bus line 18, and the handwriting editing interface 16 will be described in detail later.
Based on the basic strokes (basic images) stored in advance in the handwriting recognition dictionary (storage means) 17, which is a memory, based on the signals of the respective coordinate data indicating the pen coordinates from the input pen 12, the respective coordinates described above. The data recognition result is output to the bus line 18.

In the handwriting recognition dictionary 17, the basic strokes indicating characters and symbols are classified according to their contents, such as a horizontal writing gesture command table 27, a vertical writing gesture command table 34, and a handwriting character table 30, which will be described later. It is stored.

As an example of such a basic stroke,
For example, as shown in FIG. 3, the inverted L-letter, which is an edit symbol indicating a line feed, is filled in at the coordinate positions corresponding to each 9 × 9 grid, as indicated by ◯, that is, the coordinates corresponding to each grid. Is shown with and without the input pen 12 passing through.
It should be noted that a predetermined threshold value is set in the above-mentioned determination of presence / absence.

Although not shown, the basic stroke is set so that it can be drawn with one stroke, and the drawing direction, that is, either one of both ends of the basic stroke is stored as a starting point.

On the other hand, as shown in FIG.
A transparent tablet 19 for detecting each coordinate of the screen is integrally formed on the screen of No. 4, and the tablet 19 is formed in a grid pattern as shown in FIG. 4A. XY (640 × 400) coordinates are set, and the character arrangement of the display device 14, for example, the vertical 40 shown in FIG.
It corresponds to rows and 80 columns.

As a result, the input pen 12 shown in FIG.
When the tip end of the tablet abuts on the tablet 19, the pen coordinates on the tablet 19 are detected by the pen interface 13, converted into a coordinate code, and output to the bus line 18.

The tablet system described above is as follows:
It is not particularly limited as long as each coordinate of the locus can be detected when the input pen 12 comes into contact with and draws. And electromechanical tablets can also be used.

The display device 1 is constructed by using the above structure.
When a sentence is created on the keyboard 4, characters and symbols input from the keyboard 10 are converted into predetermined character codes and symbol codes by the key interface 11, and the respective codes are converted into the CPU 1 (the text editing unit in FIG. 1). 1
According to a), the data is temporarily stored in the RAM 2 (text memory 2a in FIG. 1).

Thereafter, the CPU 1 causes the display device 1 to execute the code stored in the RAM 2 based on the instruction from the keyboard 10 and the program stored in the ROM 3.
4 are arranged again on the RAM 2 so that they can be displayed on the screen (FIG.
Bitmap memory 2b). Then, the above RA
Each code array on M2 is displayed on the display device 14 via the display control 15.

Further, in the above configuration, the text once displayed on the display device 14 in this way is input from the keyboard 10 or the icon area set on the display device 14, or the input pen 12 described later. The CPU 1 can rearrange, that is, edit, the code arrays of the bit map memory 2b in the RAM 2 according to a predetermined program and the instruction.

Next, the gesture function for facilitating the editing of the text displayed on the display device 14 will be described. First, as shown in FIG. 1, on a display tablet 20 in which a display device 14 such as a CRT or a liquid crystal and a transparent tablet 19 provided on the display surface thereof are integrally formed. An image showing, for example, an edit symbol is drawn with the input pen 12 at a desired position of an image such as a displayed text.

Each coordinate data of such drawing is sequentially detected by the locus coordinate extracting section 21 connected to the tablet 19 and the input pen 12. At this time, among the coordinate data, the pen-down coordinate, which is the XY coordinate at which the input pen 12 and the tablet 19 first contact, is shown in FIG.
The gesture determination unit 22 to which the coordinate data from the locus coordinate extraction unit 21 is input determines whether it is in the effective region 19a or the invalid region 19b of the gesture function in the tablet 19 shown in (a). .

Further, when the gesture determining section 22 determines that the pen-down coordinates are valid, the pen-down coordinates are set according to each display screen of the display device 14, and the selection is made by the input pen 12 or the like. It is determined whether or not it is the pen button area 19c shown in FIG.

Thereafter, the pen-down coordinates are within the effective area 19a and the pen button area 1
If it is determined that it is not 9c, the trajectory determination unit 23 to which the coordinate data is input from the gesture determination unit 22,
A gesture function ON flag indicating ON of the gesture function is set in the flag designating section 24.

When the gesture function ON flag is set in the flag designating section 24, the coordinate data buffer 25 connected to the locus determining section 23 includes the pen-down coordinates for each coordinate data indicating the drawing locus. Are sequentially stored in each.

In addition, when the gesture function ON flag is set in the flag designating section 24, the gesture determining section 22 determines whether the input coordinate data is within the valid area, and whether the coordinate data is in the pen button area. The determination as to whether there is any is stopped, and all the input coordinate data are validated and output to the trajectory determination unit 23.

When the drawing by the input pen 12 is completed and the input pen 12 is in a pen-up state in which the input pen 12 is separated from the tablet 19, the locus determination unit 23 confirms that the gesture function ON flag is set. Then, all of the trajectory coordinate data are output from the data buffer 25 to the gesture command determination unit 26.

When all the coordinate data are output to the gesture command determination unit 26 as described above, the gesture function ON flag by the flag instruction unit 24 is reset.

Each locus coordinate data is normalized by the gesture command determination unit 26 and is included in the handwriting recognition dictionary 17 shown in FIG. 2, for example, each basic stroke stored in the horizontal writing gesture command table 27. The data is compared and collated sequentially.

As described above, in the above configuration, when the gesture function ON flag is set in the flag designating section 24, the gesture determining section 22 determines whether or not the input coordinate data is within the effective area. The determination as to whether or not it is the pen button area is stopped, and all the input coordinate data are validated and output to the trajectory determination unit 23.

From this fact, as shown in FIG.
If the pen-down coordinates are within the valid area 19a, even if the other locus coordinates by the input pen 12 are the invalid area 19b, the drawing by the input pen 12 is valid, and the invalid area is mistakenly drawn during the drawing. After passing through 19b, the drawing by the input pen 12 is invalidated, and the trouble of inputting again can be saved. However, as shown in FIG. 5D, when the pen-down coordinate is the invalid area 19b, the error processing is performed and the gesture function is stopped.

As shown in FIGS. 1 and 2, the gesture command determination unit 26 is included in the handwriting editing interface 16, and the trajectory coordinate extraction unit 21, gesture determination unit 22, and trajectory are also included. Judgment unit 23
The flag instruction unit 24 is included in the pen interface 13, and the coordinate data buffer 25
Has a storage area set in the RAM 2.

In the horizontal writing gesture command table 27, the one-character deletion command 27a, the space insertion command 27b, and the handwritten character input command 2 shown in FIG.
In addition to the basic stroke corresponding to 7c, for example, a plurality of basic strokes shown in FIG. 6 are stored together with the corresponding commands.

On the other hand, in the vertical writing gesture command table 34, as shown in FIG. 7, for example, a plurality of basic strokes for vertical writing are stored together with the corresponding commands. Therefore, the basic strokes for vertical writing and the basic strokes for horizontal writing shown in FIG. 7 are different from each other in six types, and other basic strokes are common.

Further, a table selecting section (selecting means) 32 is provided which can set the tables 27, 34, and 35 in the handwriting recognition dictionary 17 to be accessible or inaccessible from the gesture command determining section 26, respectively. The command selection section 32 selects
It can be set by input means such as the input pen 12 and the keyboard 10 via the text editing unit 1a.

In the table selecting section 32, each basic stroke is individually judged by the gesture command judging section 26.
It is also possible to selectively set whether to be accessible or not, and to group each of the basic strokes so that it is possible to selectively set whether accessible or not accessible for each group. .

Further, the registration buffer 33 for storing the table indicating the accessibility and inaccessibility of each command corresponding to each of the above basic strokes and calling the table arbitrarily and displaying it on the display device 14 is provided. It is provided. Further, in the registration buffer 33, when grouping is performed in the table selection unit 32, a grouping table can be stored so that, for example, all invalid, some valid, and all valid can be selected.

The above-mentioned gesture command determination unit 26
Outputs a command corresponding to the basic stroke closest to the above-mentioned locus coordinates to the text editing unit 1a as a result of comparison and collation with each of the above basic strokes, and is processed by the above-mentioned command from the supplied locus coordinates. The coordinate information of the character or the character string, that is, the position information on the display device 14 is output to the text editing unit 1a.

As a result, the text editing section 1a is
The character or symbol of the above-mentioned position information in the array of characters or symbols in the text memory 2a can be edited by deleting it or inserting it at that position.

At this time, the text editing unit 1a uses the input pen 1 after the gesture function as described above is activated.
When the input operation of the edit symbol by the gesture function of 2 is started and another edit function different from the restore function is input, the screen information in the text memory 2a displayed on the display device 14 is called and temporarily stored. A screen information buffer (storage area) 31, which is a memory to be stored, is set.

Further, the text editing section 1a stores the setting or resetting of each work flag indicating the operation status of each function in the screen information buffer 31 when the above-mentioned gesture function is activated. There is.

Therefore, the set / reset state of each work flag is detected, the signal indicating each state is output to the text editing section 1a, and stored in the screen information buffer 31 as described later. Work flag detecting / restoring means 35 is provided for resetting the current work flags based on the respective original work flags.

As described above, when the screen information and the work flag are stored in the screen information buffer 31, that is, saved, the save flag portion 31a for setting the save flag is set in the screen information buffer 31.

In the screen information buffer 31, when the next screen information is stored, the previously stored screen information and the set / reset memory of each work flag are cleared.

The text editing unit 1a receives not only the command from the gesture command determination unit 26 but also the command from the keyboard 10 as described above, and the editing by the command is performed. You can do it.

On the other hand, the locus coordinate data extracted by the locus coordinate extracting unit 21 independently of the above locus coordinate processing is output to the locus drawing unit 28 to form a locus image in which the above locus coordinate data are connected. .

The generated locus image is combined with the character string, symbol string or image currently formed in the bit map memory 2b and stored in the bit map memory 2b. Therefore, the operator can
Then, the gesture image input by tracing the tablet 19 is displayed on the display device 14 in real time.

An example of such a gesture editing operation is shown in FIGS. 8 and 9. First, in FIG. 8, when erasing one character “e” in the text displayed on the display tablet 20, the input pen 12 makes a gesture like “V” on the character “e”, That is, after drawing, the input pen 12 is moved to the display tablet 20.
Separate from the top.

In the above drawing, it is important for the recognition of the above character that the starting position is within the drawing range of the above character. In order to easily and accurately recognize the position of the character for which the erasure / erasure system is instructed as described above,
It is desirable to start drawing from almost the center of the drawing range of the above character.

Subsequently, the locus coordinates are extracted, the locus image is displayed on the display device 14 of the display tablet 20, and a single character corresponding to the drawing of "V" obtained by collation with the basic stroke is erased. Along with the command, the position information of the character "e" is output to the text editing unit 1a.

Thereafter, based on the above position information, the cursor 14a on the display device 14 is moved from the original position, for example, the position of the character "HO" to the position operated by the input pen 12, that is, the character "E" in the above case. After moving to the position
By deleting the "e" in the text memory 2a based on the command, the character "e" in the bitmap memory 2b is erased, and the "e" in the display device 14 is deleted. Is erased. In this way, the gesture editing is completed.

Further, as shown in FIG. 9, each editing symbol is displayed on the display tablet 20 by an input pen (not shown).
By drawing on the above, it is possible to edit the gesture as described above. The basic stroke, which is the image of the above-mentioned edit symbol, can be arbitrarily set.

Next, the pointing function with the above configuration will be described. First, in the conventional word processor, the cursor is sequentially moved when a plurality of characters on the text are designated as an area.
Directly input the position of the cursor 14a as shown in
By the instruction of 2, the movement instruction can be directly issued.

The switching between the gesture and the pointing is determined by whether or not the extracted coordinates are the coordinates of one point without a locus, that is, whether or not the above coordinates are continuous. Such a determination is made by the trajectory determination unit 23.

Therefore, for example, when it is determined to be pointing, the obtained coordinates are not collated with the gesture command table 27, and only the position information of the coordinates is output to the text editing section 1a.

Next, handwritten character input will be described using the above configuration. The input of handwritten characters can be executed by the same processing method as the above-mentioned gesture editing in which the trajectory coordinates are collated with the basic strokes stored in advance.

That is, as shown in FIG. 1, the handwritten character recognizing unit 2 is provided at the same processing position as the gesture command determining unit 26, that is, in the handwriting editing interface 16.
9 is formed and the handwritten character table 30 in which handwritten characters are stored in advance is formed in the handwriting recognition dictionary 17 shown in FIG.

The handwritten character recognition unit 29 collates the locus coordinates supplied from the locus coordinate extraction unit 21 with a plurality of basic character strokes stored in the handwritten character table 30 to find the most similar basic character stroke. The character code corresponding to is output from the handwritten character table 30 to the text editing unit 1a.

The difference between such a handwritten character input function and the above-mentioned gesture editing function is that the handwritten character recognition unit 29 does not output position information. The above-mentioned handwritten character input function can be activated from an instruction from the keyboard 10 or an icon from the display device 14, and a gesture for horizontal writing, for example, on the tablet 19 of the display tablet 20. In the case of the function, as shown in FIG. 6, it is possible to start up from the gesture editing function by gesturing “Δ”.

An example of the operation of the handwritten character input function will be described. As shown in FIG. 11, when the handwritten character input function is activated, the display tablet 2 is activated.
Window 1 for inputting handwritten characters at a predetermined position of 0
4b is displayed, and in the first input area in the window 14a, a character is handwritten with the input pen 12, for example, "su".

After that, when the input pen 12 is brought into contact with the adjacent second area for the next input, at that time, the first area
Character recognition of the locus coordinates handwritten in the area is executed as described above by the handwritten character recognition unit 29 with reference to the handwritten character table 30, and the character of the recognition result is input to the position indicated by the cursor 14a. It is designed to be displayed.

Thus, for example, a font such as a cursive font is stored in the handwritten character table 30 in advance, and the cursive character is input by handwriting, and the handwritten character table 30
It is possible to display and print cursive fonts in.
In each of the above-mentioned gesture functions, the example of the gesture function for horizontal writing has been given, but the same applies to the gesture function for vertical writing.

Next, an operation example of each editing function including the restoration function of the gesture function in the configuration of the above-described first embodiment will be described with reference to the flowchart of FIG. First, when the text displayed on the display device 14 is edited, the handwriting editing by the gesture function using the input pen 12 or another editing method, for example, the key editing by the keyboard 10 is selected (step 1, step S below).
Abbreviated).

At this time, it is determined whether handwriting editing by the gesture function or another editing method is selected (S2), and when another editing method is selected, the flag in the save flag section 31a is reset (S3), Perform normal editing processing (S
4), the process is completed.

On the other hand, in the case of handwriting editing by the gesture function, it is subsequently determined whether the handwriting editing is a restoration function or another editing function (S5), and if another editing function, for example, erasing one character, The editing function is selected (S6),
After that, the document data necessary for restoration and the work flag at that time are saved in the screen information buffer 31 (S7).
Then, after setting the save flag in the save flag section 31a (S8), the above-mentioned editing function is executed (S9) to complete the process.

On the other hand, if the determination in S5 is the restoration function, it is first determined whether the save flag of the save flag section 31a is in the set state or the reset state (S10), and if it is in the reset state. , The error processing such as a buzzer is performed (S11), and the processing ends.

If the save flag is in the set state, the original screen information previously stored in the screen information buffer 31 and the work flag are called to execute the restoration process (S12). The save flag of the unit 31a is reset (S13), and the process is completed.

Next, a specific example of the above operation example will be described with reference to FIG.
Referring to FIG. 16 to FIG. 16, first, FIG.
As shown in FIG. 5, a single character erasing mechanism of the handwritten edit symbol is input by handwriting with the input pen 12 to, for example, “hill” in the text on the display screen of the display device 14.

In this way, when the one-character erasure, which is another editing function different from the restoration function, is input, the text memory 2a shown in FIG. 1 in the RAM 2 shown in FIG. 2 for the restoration processing.
The current document data in 1) and the work flag commonly used by all the functions at that time are temporarily saved in the screen information buffer 31 in another area of the RAM 2.

After that, the save flag of the save flag portion 31a in the RAM 2 is set. Then, when the process for the restoration process is finished, the one-character erasing process is actually executed as shown in FIG.

After that, when the above-mentioned one-character erasing process is an error and the original sentence is restored, first, the input pen 12
And, as shown in FIG. 15, the restoration symbol of the handwritten edit symbol is input by the tablet 19. After that, the save flag in the save flag unit 31a is checked. If the save flag in the save flag unit 31a is in the reset state, the handwriting editing / restoring process cannot be executed, so the process shifts to an error process such as a buzzer and the process ends.

On the other hand, if the save flag in the save flag section 31a is set, the screen information buffer 31
The original screen information and the work flag at that time are called from, and as shown in FIG. 16, the restoration processing of the character “hill” erased by handwriting edit single character deletion is executed. Subsequently, the save flag in the save flag unit 31a is reset in order to disable the restore process after the restore process is executed. The squares in FIGS. 14 and 16 described above indicate the cursor position.

As described above, in the configuration of the first embodiment described above, the document data and the work flag at that time are saved before the handwriting editing is executed, so that the restoration processing is performed even when the handwriting editing is executed by mistake. Simply specify to restore the document data and the work flag at that time,
The document on the display device 14 can be quickly and surely restored to the state before handwriting editing.

As a result, in the above configuration, since the previous screen information and the work flag are stored in advance when canceling the above-mentioned handwriting editing, for example, as shown in FIG. 17, the locus display of the input pen 12 is displayed. Even if a rectangular display of the recognition area, the display of recognition information, a list of recognition displays of the editing function, a message asking whether to cancel the processing result, etc. are displayed, after deleting the above display or message once, the text You can save the trouble of rearranging the data. Therefore, with the above configuration, the redisplay of the editing screen, the execution of the recognition function, the cancellation of the editing process, and the like can be speeded up.

Next, an operation example of the horizontal writing gesture function and the vertical writing gesture function in the configuration of the first embodiment will be described with reference to FIG. First, in the above configuration, vertical writing or horizontal writing is set in the format information stored in the text memory 2a as shown in FIG. 21, and for example, 0 is set for vertical writing, and horizontal writing is set. 1
Is set to.

First, when the gesture function is activated, the text editing section 1a determines the above format information (S2).
1) If the text editing unit 1a determines that the writing is horizontal,
Based on the result, the table selection unit 32 sets the horizontal writing gesture command table 27 to be accessible, sets the vertical writing gesture command table 34 to be inaccessible, and refers to the horizontal writing gesture command table 27 to recognize for horizontal writing. Is executed (S2
2).

On the other hand, if the text editing unit 1a determines that the writing mode is vertical writing, the table selecting unit 32 sets the horizontal writing gesture command table 27 to be inaccessible based on the result, and makes the vertical writing gesture command table 34 accessible. The vertical writing gesture command table 34 is set and the vertical writing recognition is executed (S23).

Then, the text editing unit 1a executes editing based on the above recognition result (S24), displays the result on the display device 14 (S25), and the process is completed.

As described above, since the tables 27 and 34 can be individually referred to according to the format settings of horizontal writing and vertical writing, editing by the gesture function in horizontal writing, for example, as shown in FIG. In, the centering edit can be performed by the drawing trajectory 12a in the horizontal writing, while the editing of the gesture function in the vertical writing, for example, as shown in FIG. 20, the centering editing can be performed by the drawing trajectory 12a in the vertical writing. It will be possible.

For the recognition by both of the above, as shown in Table 1, for example, the normalized coordinate data and the table 27 are used.
The coordinate data of the basic stroke stored in 34 is compared and collated and executed.

[0090]

[Table 1]

Therefore, if each basic stroke for recognizing both of the above is stored in one table and the above-described recognition operation is executed, the number of basic strokes increases, and the number of basic strokes is increased. Although it often takes time to compare and collate, in the above configuration, for example, the format setting that is first set when creating a sentence is used to compare and collate with each basic stroke of one of the tables 27 and 24. It suffices to set whether each of the tables 27 and 34 is accessible or not, so that the recognition elapsed time of comparison and collation with each basic stroke can be shortened.

Next, another embodiment of the present invention will be described as a second embodiment with reference to FIGS. 6 and 7 and FIGS. 22 and 23. In addition, each member having the same function as that of the above-described first embodiment is given the same member number, and the description thereof is omitted.

[Embodiment 2] In the information processing apparatus, as shown in FIG. 22, each basic stroke is stored together with the corresponding command in, for example, a horizontal writing gesture command table 27. 6
As shown in FIG. 7 and FIG. 7, a common basic stroke, for example, erasing one character is included, while horizontal writing and vertical writing are different, but for example, a basic stroke for horizontal writing is about 9
When rotated clockwise by 0 °, a convertible basic stroke (hereinafter referred to as a convertible stroke) that matches the basic stroke for vertical writing is included.

Further, in the above configuration, when storing the above-mentioned convertible stroke, it can be used as the other basic stroke by rotation conversion in a part of the head portion or the like which stores the address and the like of the storage area. Is stored, for example, 0 is stored.

Therefore, the text editing unit 1a determines whether the text currently being edited is in vertical writing or horizontal writing. As a result, in the case of vertical writing, the gesture command determining unit 2
The determination result is output to 6.

In the above structure, if the basic stroke called from the horizontal writing gesture command table 27 is a convertible stroke based on the instruction signal from the gesture command determining section 26, the convertible stroke is rotated. A conversion unit 36 that converts and outputs to the gesture command determination unit 26 is set.

Next, an operation example of the configuration of the second embodiment will be described with reference to the flowchart of FIG. 23. First, when the gesture function is activated, the operation of the first embodiment is performed.
The text editing unit 1a determines the format information described in (S31).

If the text editing unit 1a determines that the writing is horizontal writing, the gesture command determining unit 26 determines the horizontal writing gesture command table 27 based on the result.
Each basic stroke is called from (S32), the basic stroke is compared with the drawing by the gesture function, and the horizontal writing recognition is executed (S33).

On the other hand, when the text editing unit 1a determines that the writing is vertical writing, the gesture command determining unit 26 calls each basic stroke from the horizontal writing gesture command table 27 based on the result (S34). Is a convertible stroke or not (S35).

If the stroke is convertible, it is converted by the converting means 36 in the clockwise direction by about 90 ° (S3).
6), output to the gesture command determination unit 26. On the other hand, if it is not a convertible stroke, it is determined that conversion is unnecessary, the basic stroke is output to the gesture command determination unit 26, and the process proceeds to S33.

In S33, the gesture command determination unit 26 sequentially compares and collates each called basic stroke with the drawing coordinate data of the gesture function. If they do not match within a predetermined range, the process returns to S31 and waits. It becomes a state.

On the other hand, the gesture command determination unit 26 compares and collates the called basic stroke with the drawing coordinate data of the gesture function, and if they match within a predetermined range, the recognition is completed and the recognition result is shown. Based on this, horizontal writing or vertical writing is executed (S34), the editing result is displayed on the display device 14 (S35), and the process is completed.

As described above, in the configuration of the second embodiment, each basic stroke in the horizontal writing gesture command table 27 is identified and stored as a convertible stroke that can be converted to vertical writing and a common basic stroke different from them. In vertical writing, the above-described convertible strokes are converted by the converting means 36 and output to the gesture command determination unit 26, so that the horizontal writing and the vertical writing are the same. The horizontal writing gesture command table 27 of FIG.

Therefore, in the above-mentioned configuration, when each basic stroke for recognizing both of the above is stored in one table and the above-described recognition operation is executed, the number of basic strokes increases and each of them is increased. Although it takes time to compare and collate with the basic stroke, in the above configuration, for example, using the format setting that is first set when creating a sentence,
It suffices to compare and collate each basic stroke of the horizontal writing gesture command table 27, and it is possible to shorten the recognition elapsed time of the comparative collation with each basic stroke.

Also, the storage area in the horizontal writing gesture command table 27 can be reduced, the memory area for the user can be increased, and the range of use for application programs and the like can be expanded.

Moreover, in the above configuration, the rule of rotation conversion in the conversion means 36 can be set to a simple one,
On the other hand, if you can remember the convertible stroke for horizontal writing, for example, you can easily assume the convertible stroke for vertical writing, and you can edit with the gesture function for horizontal writing and vertical writing, and it is necessary to remember. The number of certain basic strokes can be reduced. This makes it possible to improve the recognition rate of each basic stroke.

[0107]

As described above, the information processing apparatus according to the first aspect of the present invention is capable of editing an image such as an arrangement of characters and symbols on the display surface of a display device such as a liquid crystal display as an image. When is activated, a storage area for storing image information indicating an image on the display surface at the time of activation and a work flag indicating the operation status of each function is set.

Therefore, in the above configuration, since the original image information is stored in the storage area in advance when editing by the gesture function, for example, the image by the gesture function is displayed on the display surface at the time of editing as in the conventional case. It saves the trouble of displaying the original image information and then arranging and displaying the original image information again. You can revert to an image.

In addition, in the above configuration, since the work flag indicating the operation status before the editing by the gesture function is also stored, even if the work flag is changed by the editing operation, the work flag is reset. It is possible to return to the original work flag, that is, to return to the original operation status, by omitting the trouble of.

Therefore, the above-described structure has an effect that the restoration process at the time of restoring the original image can be speeded up due to an incorrect editing process or the like.

The information processing apparatus according to claim 2 of the present invention is
As described above, in the gesture function that can be edited by the drawn image, the horizontal writing storage area for storing the horizontal writing command for editing the horizontally arranged images and the horizontal writing basic image corresponding to the horizontal writing command is stored in the storage means. In the gesture function, a vertical writing storage area for storing a vertical writing command for editing vertically aligned images and a vertical writing basic image corresponding to the vertical writing command is stored in the storage means. A selection means is provided, which selects either the horizontal writing storage area or the vertical writing storage area so as to be callable.

Therefore, since the above-mentioned configuration is provided with the above-mentioned selection means, when an image is input, it is compared with the basic image of one of the horizontal writing storage area and the vertical writing storage area. The comparison processing time of the above configuration can be reduced as compared with the comparison processing time in the case where, for example, the last basic image and the image are compared and coincide with each other by sequentially comparing each of the basic images. Has the effect.

An information processing apparatus according to claim 3 of the present invention is
As described above, it has a gesture function that can be edited by an image drawn by being specified by being compared with the stored basic image, and the basic image is common to both vertical writing and horizontal writing. Of the above-mentioned convertible basic image stored as a basic image for either horizontal writing or vertical writing, including a common basic image of and a convertible basic image convertible between vertical writing and horizontal writing, The configuration is such that conversion means for converting to the other for horizontal writing or vertical writing based on the other signal is provided.

Therefore, in the above configuration, in a command that can edit a horizontally written sentence and a vertically written sentence, the convertible basic images that can be used for both can be mutually converted, so that the conversion that is also used can be performed. The basic images have similarities to each other and are easily recognizable.

Therefore, with the above configuration, it is possible to edit, for example, both horizontally written sentences and vertically written sentences by the gesture function, the editing function is improved, and the recognition rate due to the increase in the number of basic images is increased. It is possible to avoid the decrease of

[Brief description of drawings]

FIG. 1 is a block diagram of a main part of an information processing device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of the information processing device.

FIG. 3 is an explanatory diagram showing a storage example of a basic stroke in the information processing apparatus.

FIG. 4 shows a display tablet in the above information processing apparatus, and FIG. 4 (a) is an explanatory diagram showing respective coordinates shown by dividing the tablet of the display tablet.
(B) is an explanatory view showing a vertical or horizontal writing arrangement of the display device of the display tablet.

5A and 5B show a display tablet in the information processing apparatus, FIG. 5A is an explanatory view showing an effective area and an invalid area, FIG. 5B is an explanatory view showing a pen button area, and FIG. FIG. 3D is an explanatory diagram showing an example of an invalid drawing trajectory.

FIG. 6 is an explanatory diagram showing an example of a basic stroke for horizontal writing in the information processing apparatus.

FIG. 7 is an explanatory diagram showing an example of a basic stroke for vertical writing in the information processing apparatus.

FIG. 8 is an explanatory diagram showing a usage example of a gesture function in the information processing apparatus.

FIG. 9 is an explanatory diagram showing another usage example of the gesture function of the information processing apparatus.

FIG. 10 is an explanatory diagram showing a pointing function in the above gesture function.

FIG. 11 is an explanatory diagram showing a handwritten character input function in the above gesture function.

FIG. 12 is a flowchart showing a save function in the above gesture function.

FIG. 13 is an explanatory diagram showing an initial screen in a specific example of the save function.

FIG. 14 is an explanatory diagram showing an editing screen in which one editing process is executed on the initial screen.

FIG. 15 is an explanatory diagram showing a restoration instruction screen in which a restoration editing symbol is input on the editing screen.

FIG. 16 is an explanatory diagram showing an initial screen restored from the above restore instruction screen.

FIG. 17 is an explanatory diagram showing respective display screens on which various editing processes in the above-mentioned gesture function have been executed.

FIG. 18 is a flowchart at the time of recognizing and executing horizontal writing and vertical writing in the above gesture function.

FIG. 19 shows an example of horizontal writing by the above-mentioned gesture function, (a) is a display screen in which an edit symbol is input,
(B) is an explanatory view showing a display screen on which editing by the editing symbol is executed.

FIG. 20 shows an example of vertical writing by the above-mentioned gesture function, (a) is a display screen in which an edit symbol is input,
(B) is an explanatory view showing a display screen on which editing by the editing symbol is executed.

FIG. 21 is an explanatory diagram showing a storage area of format information for identifying horizontal writing and vertical writing in the gesture function.

FIG. 22 is a block diagram of a main part of the information processing device according to the second embodiment of the present invention.

FIG. 23 is a flowchart showing conversion of basic strokes in the above information processing device.

[Explanation of Codes] 12 Input Pen 14 Display Device 19 Tablet 31 Screen Information Buffer (Storage Area)

 ─────────────────────────────────────────────────── ─── Continuation of front page (72) Inventor Yuji Okano 22-22 Nagaike-cho, Abeno-ku, Osaka-shi, Osaka Within Sharp Corporation (72) Inventor Hiroyuki Shigematsu 22-22 Nagaike-cho, Abeno-ku, Osaka-shi, Osaka Osaka Within the corporation

Claims (3)

[Claims] 1. A tablet provided with a display device such as a liquid crystal display and capable of inputting an image by drawing with an input pen and designating a desired position on the display surface of the display device is provided on the display surface. In an information processing device provided with a gesture function capable of editing an image such as an arrangement of characters and symbols on the display surface with the image, when the gesture function is activated, an image on the display surface at the time of activation is displayed. An information processing apparatus, wherein a storage area for storing image information shown and a work flag showing an operation status of each function is set. 2. A display device such as a liquid crystal display for displaying an image of an arrangement of characters and symbols is provided, and an image can be input by drawing with an input pen or a desired position on the display surface of the display device. A tablet that can be used for pointing and the like is provided on the display surface, and a storage unit that stores in advance a command for editing the image and a basic image corresponding to the command is provided, and the image for editing is provided. And a basic image called from the storage means are compared to select a command corresponding to the image,
In an information processing device having a gesture function of editing the image with the above command, a horizontal writing memory area for storing a horizontal writing command for editing horizontally arranged images and a horizontal writing basic image corresponding to the horizontal writing command is provided. A storage area for vertical writing, which is provided in the storage means and stores a vertical writing command for editing vertically aligned images and a vertical writing basic image corresponding to the vertical writing command, is provided in the storage means. An information processing apparatus is further provided with a selection unit that selects one of the horizontal writing storage area and the vertical writing storage area so as to be callable. 3. A display device such as a liquid crystal display for displaying an image of an arrangement of characters and symbols is provided, and an image can be input by drawing with an input pen or a desired position on the display surface of the display device can be displayed. A tablet that can be designated or provided is provided on the display surface, and a storage unit that stores in advance a command for editing the image and a basic image corresponding to the command is provided, and the image for editing is provided. In an information processing apparatus having a gesture function of comparing a basic image called from the storage means with a command corresponding to the image and editing the image with the command, the basic image is for vertical writing. Includes a common basic image common to both horizontal writing and a convertible basic image convertible between vertical writing and horizontal writing, Conversion means is provided for converting the convertible basic image stored as one of the horizontal or vertical writing basic images to the other based on a signal indicating the other of horizontal writing or vertical writing. An information processing device characterized by the above.