JP3874571B2 - Gesture processing device and gesture processing method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information processing apparatus that can perform handwritten editing with a pen or the like on a screen, and particularly relates to a gesture processing apparatus and a gesture processing method.
[0002]
[Prior art]
2. Description of the Related Art In recent years, information devices, so-called pens, that are equipped with a display device that integrates a display portion such as a liquid crystal display and a tablet that detects the coordinates of a contact portion with an input pen or the like and that can be directly edited by an input pen Information input-type information devices are appearing on the market. Therefore, the display device can realize on the tablet the same as the calibration on the manuscript paper, as if reminiscent of paper and a pen. Sharp's Japanese word processor "WV-S200" is known.
[0003]
In these pen information input devices, a gesture function has been considered as a function for making the most of the characteristics. Such a gesture function is a method of drawing a text on a display device by drawing a character or the like at a desired position on a tablet with an input pen using an editing symbol stored in advance. It can be edited.
[0004]
[Problems to be solved by the invention]
However, in the above conventional method, after the pen-down at the start of drawing and the pen-up at the completion of drawing is completed, it is determined whether the gesture function by the input pen is valid or invalid. It was. Further, in the above conventional case, when the input pen passes an area such as an icon which is an invalid area of the gesture function during drawing, the gesture function is cancelled. Therefore, it is necessary to draw on the tablet, and there is a problem that the gesture function is troublesome.
[0005]
Further, in the above-described conventional case, for example, the user may unintentionally input an edit symbol for deletion or deletion and edit it into an unintended sentence, and there is a problem that it takes time to restore such a sentence. Has occurred.
[0006]
Furthermore, in the above-described conventional case, in order to make the gesture function function effectively, the locus of the input pen, the list of edit symbols, and the like can be displayed. There is also a problem that the processing time increases and the processing speed decreases.
[0007]
[Means for Solving the Problems]
  In order to solve the above problems, the gesture processing apparatus of the present invention outputs a stroke of continuous coordinates on the display surface of the display means indicated by the display means such as a liquid crystal display and the input means such as an input pen. A coordinate extracting unit that determines whether the display position corresponding to the first coordinate output from the coordinate extracting unit is an effective area in which information to be edited is displayed;Pointing processing means for moving the cursor to the first coordinate position determined to be an effective area by the determination means;Strokes that continue to the first coordinates determined to be outside the effective area by the determination means are not captured, but strokes that are consecutive to the first coordinates determined to be the effective area are captured and stored in advance.MatchAnd a gesture recognition means for outputting an edit command corresponding to the closest basic stroke, and displayed in the effective area on the display means based on the edit command output from the gesture recognition means.Indicated by the cursorAnd an editing means for editing information.
[0008]
  Furthermore, the gesture processing of the present inventionThe determination means of the apparatus is characterized in that the region determination is not performed for coordinates that are continuous with the first coordinate in the effective region.
[0009]
  The gesture processing of the present inventionThe method includes: a gesture processing method in a gesture processing apparatus, comprising: display means such as a liquid crystal display; and coordinate extraction means for outputting a stroke of continuous coordinates on the display surface of the display means designated by the input means such as an input pen. Then, it is determined whether or not the display position corresponding to the first coordinate output from the coordinate extracting means is a predetermined effective area in which information to be edited is displayed, and is outside the effective area After the cursor is moved to the first coordinate position determined to be an effective area, the stroke continuous to the first coordinate determined to be an effective area is not taken. Checks the basic strokes stored in advance and outputs the editing command corresponding to the closest basic stroke. Based on the output editing command To edit the information that is indicated by being displayed on the effective area of the display unit cursorIt is characterized by that.
[0011]
According to the present invention, the gesture function is enabled / disabled by the output of the first specified coordinate on the display surface by the coordinate extraction unit, which is instructed by the input unit such as the input pen during the gesture function. And a gesture recognizing unit that outputs an edit command by a subsequent stroke, the validity / invalidity of the gesture function and the intended command can be accurately determined and extracted.
[0012]
In addition, according to the present invention, the valid / invalid area determination is not performed for the coordinates of the stroke input after the first coordinates are output by the input means. If the first coordinates are valid, for example, Even if subsequent successive strokes are drawn in the invalid area of the gesture function, the gesture function itself is not invalidated.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
An embodiment of the present invention will be described with reference to FIGS. 1 to 23 as follows. In the gesture processing apparatus as the information processing apparatus, as shown in the block diagram of FIG. 2, a central processing unit (hereinafter referred to as a CPU) 1 for executing a program is provided, and the bus line 18 of the CPU 1 RAM 2 for storing and reading various data, ROM 3 for storing control programs, printer controller 4 for controlling printer 5, IC card interface 7 for reading and writing to IC card 6 as external storage means, and An FD controller 9 for controlling a floppy disk drive (hereinafter referred to as FDD) 8 is connected.
[0014]
Further, the bus line 18 has a key interface 11 for inputting signals from the keyboard 10 as input means to the bus line 18 and a display for controlling a display device 14 (display means) such as a liquid crystal display. The control 15 is connected.
[0015]
In addition, the bus line 18 is in contact with the image of the display device 14, and signals from the input pen 12 for inputting or selecting information are converted into pen coordinates to be converted to the bus line 18. A pen interface 13 for inputting is connected. Therefore, the input pen 12 can display information on the image by drawing a predetermined image on the image or a so-called pointing function indicating the image. It is an input means for a gesture function that allows selection and input of edit symbols.
[0016]
Also, a handwriting editing interface 16 is connected to the bus line 18, and the handwriting editing interface 16, as will be described in detail later, is a signal of each coordinate data indicating the pen coordinates from the input pen 12. Thus, the recognition result of each coordinate data is output to the bus line 18 based on the handwriting recognition dictionary (storage means) 17 which is a memory.
[0017]
In the handwriting recognition dictionary 17, the basic strokes indicating characters and symbols are classified according to the contents, such as (1) horizontal writing gesture command table, (2) handwritten character table, and (3) vertical writing gesture command table, which will be described later. Each has been stored. As an example of such a basic stroke, an inverted L character, which is an edit symbol indicating a line feed, is embedded in a position corresponding to each of 9 × 9 squares as indicated by a circle as shown in FIG. Has been.
[0018]
On the other hand, as shown in FIG. 2, a transparent tablet (coordinate extracting means) 19 for detecting each coordinate of the screen is integrally formed on the screen of the display device 14. The XY (640 × 400) coordinates are arranged in a grid pattern shown in FIG. 4A so as to correspond to the character arrangement of the display device 14, for example, the vertical 40 rows and horizontal 80 examples shown in FIG. Is set.
[0019]
Thus, when the tip of the input pen 12 shown in FIG. 2 abuts on the tablet 19, the pen coordinates on the tablet 19 are detected by the pen interface 13, converted into a coordinate code, and the bus line. 18 is output.
[0020]
The tablet system is not particularly limited as long as the coordinates of the locus can be detected when the input pen 12 is in contact with the drawing, but for example, an electrostatic coupling tablet, an electric strain and a magnetic strain can be used. Tablets, pressure sensitive, ultrasonic and electromechanical tablets can also be used.
[0021]
When a sentence is created on the display device 14 using such a configuration, characters and symbols input from the keyboard 10 are converted into predetermined character codes and symbol codes by the key interface 11, respectively. Each code is temporarily stored in the RAM 2 once by the CPU 1 (text editing unit 1a in FIG. 1) (text memory 2a in FIG. 1).
[0022]
After that, the code stored in the RAM 2 is rearranged on the RAM 2 so that the CPU 1 can display it on the display device 14 based on the instruction from the keyboard 10 and the program stored in the ROM 3 (in FIG. 1). Bit map memory 2b). Subsequently, each code arrangement on the RAM 2 is displayed on the display device 14 via the display control 15.
[0023]
In the above configuration, the text once displayed on the display device 14 can be edited by the keyboard 10, an icon set on the display device 14, or an instruction by the input pen 12 described later, and the CPU ( The editing means) 1 can rearrange, that is, edit, each code arrangement of the bitmap memory 2b in the RAM 2 in accordance with a predetermined program and the above instruction.
[0024]
Next, a gesture function for facilitating editing of the text displayed on the display device 14 will be described. First, as shown in FIG. 1, on a display tablet 20 in which a display device 14 such as a CRT or a liquid crystal and a transparent tablet 19 provided on the display surface are integrally formed, on the display device 14. For example, an image indicating an edit symbol is drawn by the input pen 12 at a desired position of the displayed image such as a sentence.
[0025]
Each coordinate data of such drawing is sequentially detected by the locus coordinate extraction unit 21 connected to the tablet 19. At this time, in the coordinate data, the pen-down coordinate that is the XY coordinate where the input pen 12 and the tablet 19 first contact each other is within the effective area 19a of the gesture function in the tablet 19 shown in FIG. It is determined by the gesture determination unit (determination means) 22 to which the coordinate data from the locus coordinate extraction unit 21 is input whether it is within 19b.
[0026]
Further, when the gesture determination unit 22 determines that the pen-down coordinate is valid, the pen-down coordinate is set according to each display screen on the display device 14 and is selected by the input pen 12. It is determined whether it is a pen button area.
[0027]
Thereafter, when it is determined that the pen-down coordinate is within the effective area and not the pen button area, the locus determination unit 23 to which coordinate data is input from the gesture determination unit 22 indicates that the gesture function is ON. The gesture function ON flag is set in the flag instruction unit (stop means) 24.
[0028]
When the gesture function ON flag is set in the flag instruction unit 24, each coordinate data indicating the drawing trajectory is sequentially stored in the coordinate data buffer 25 connected to the trajectory determination unit 23 including the pen-down coordinate. Remembered.
[0029]
In addition, when the gesture function ON flag is set in the flag instruction unit 24, the gesture determination unit 22 determines whether or not the input coordinate data is within the valid area and whether or not the pen button area. This determination is stopped, and all the input coordinate data are validated and output to the locus determination unit 23.
[0030]
When the drawing with the input pen 12 is finished and the input pen 12 is in a pen-up state in which the input pen 12 is separated from the tablet 19, the trajectory determination unit 23 confirms that the gesture function ON flag is set, All the locus coordinate data is output from the data buffer 25 to the gesture command determination unit (gesture recognition means) 26.
[0031]
Note that when all the coordinate data is output to the gesture command determination unit 26 as described above, the gesture function ON flag by the flag instruction unit 24 is reset.
[0032]
Each locus coordinate data is normalized by the gesture command determination unit 26 and collated with basic stroke data stored in the gesture command table 27 included in the handwriting recognition dictionary 17 shown in FIG. The gesture command determination unit 27 is included in the handwriting editing interface 16, and the locus coordinate extraction unit 21, the gesture determination unit 22, the locus determination unit 23, and the flag instruction unit 24 include the pen The coordinate data buffer 25 is included in the interface 13, and a storage area is set in the RAM 2.
[0033]
In the gesture command table 27, in addition to the basic strokes corresponding to the single character deletion command 27a, the space insertion command 27b, and the handwritten character input command 27c shown in the figure, for example, a plurality of basic strokes shown in FIGS. Are stored together with the corresponding commands.
[0034]
In addition, a command selection unit (selection means) 32 that can select and set each basic stroke in the gesture command table 27 by selecting whether access from the gesture command determination unit 26 is possible or not is provided. The selection in the unit 32 can be set by an input means such as the input pen 12 or the keyboard 10 via the text editing unit 1a.
[0035]
In the command selection unit 32, each basic stroke can be individually set to be accessible or inaccessible from the gesture command determination unit 26, and each basic stroke is grouped, For each group, access and inaccessibility can be selected and set (setting means).
[0036]
In addition, a registration buffer 33 is provided for storing, in a table, the accessibility and inaccessibility of each command corresponding to each of the basic strokes, and calling the table arbitrarily and displaying it on the display device 14. Yes. Further, in the registration buffer 33, when grouping is performed in the command selection unit 32, for example, a grouping table can be stored so that all can be selected from invalid, partially valid, and all valid.
[0037]
The gesture command determination unit 27 outputs a command corresponding to the basic stroke closest to the trajectory coordinate to the text editing unit 1a as a result of collation with each of the basic strokes, and supplies the supplied trajectory. From the coordinates, the coordinate information of the character or character string processed by the command, that is, the position information on the display device 14 is output to the text editing unit 1a.
[0038]
As a result, the text editing unit 1a can edit the character or symbol in the position information in the text memory 2a by deleting or inserting the character or symbol in the position information. At this time, the text editing unit 1a calls the screen information in the text memory 2a displayed on the display device 14 when the gesture function as described above is activated, that is, immediately before the input operation with the input pen 12 is started. A screen information buffer (storage area) 31 is set as a memory to be temporarily stored. In the screen information buffer 31, when the next screen information is stored, the previously stored screen information is cleared.
[0039]
Thereby, since the previous screen information is stored in advance when the above editing is canceled, for example, as shown in FIG. 17, the locus display of the input pen 12, the rectangular display of the recognition area, the display of the recognition information, and the recognition Even when a display list, a message asking whether or not to cancel the processing result, and the like are displayed, it is possible to speed up the execution of redisplaying the editing screen, executing the recognition function, canceling the editing process, and the like.
[0040]
The text editing unit 1a is not only input with commands from the gesture command determination unit 27, but also receives commands from the keyboard 10 as described above so that editing can be performed using the commands. It has become.
[0041]
On the other hand, independent of the above-described processing of the trajectory coordinates, the trajectory coordinate data extracted by the trajectory coordinate extraction unit 21 is output to the trajectory drawing unit 28 and becomes a trajectory image obtained by connecting the trajectory coordinate data.
[0042]
The generated trajectory image is combined with the character string, symbol string, or image currently formed in the bitmap memory 2b and stored in the bitmap memory 2b. Therefore, the gesture image input by the operator by tracing the tablet 19 with the input pen 12 is displayed on the display device 14 in real time.
[0043]
Examples of such gesture editing operations are shown in FIGS. First, in FIG. 8, when erasing one character “E” in the text displayed on the display tablet 20, a gesture like “V” is performed on the character “E” with the input pen 12. That is, after drawing, the input pen 12 is moved away from the display tablet 20.
[0044]
In the above drawing, it is important for the recognition of the character that the starting position is within the range of the character. In particular, in order to facilitate the recognition of the designated character, it is desirable to start drawing from substantially the center of the character.
[0045]
Subsequently, the trajectory coordinates are extracted and the trajectory image is displayed on the display device 14 of the display tablet 20, and with a single character deletion command corresponding to the drawing of “V” obtained by collation with the basic stroke, The position information of the character “e” is output to the text editing unit 1a.
[0046]
Thereafter, based on the position information, the cursor 14a on the display device 14 is moved to the original position, for example, the position where the input pen 12 is operated from the position of the character "H", that is, the position of the character "E" in the above case. , The character “e” in the bitmap memory 2b is deleted by deleting the character “e” in the text memory 2a based on the command. The above “e” in Era is deleted. In this way, gesture editing is completed.
[0047]
Also, as shown in FIG. 9, gesture editing can be performed in the same manner as described above by drawing each editing symbol on the display tablet 20 with an input pen (not shown). Note that the basic stroke, which is the image of the edit symbol, can be arbitrarily set.
[0048]
Next, the pointing function configured as described above will be described. First, in the conventional word processor, the cursor is sequentially moved when a plurality of characters on the text are designated. However, in the above configuration, the position of the cursor 14a is directly instructed by the instruction of the input pen 12. It is possible.
[0049]
Note that the switching between the gesture and the pointing is determined based on whether or not the extracted coordinates are one-point coordinates without a locus, that is, whether or not each of the coordinates is continuous. The determination is performed by the locus determination unit 23.
[0050]
Therefore, for example, when it is determined that the pointing is performed, the obtained coordinates are not collated with the gesture command table 27, and only the position information of the coordinates is output to the text editing unit 1a. An example of the operation of such a pointing function is as shown in FIG.
[0051]
Next, handwritten character input will be described using the above configuration. The handwritten character input can be executed by the processing method equivalent to the processing in which the gesture editing is performed by comparing the locus coordinates with the previously stored basic stroke.
[0052]
That is, as shown in FIG. 1, a handwritten character table in which a handwritten character recognition unit 29 is formed in the same position as the gesture command determination unit 26, that is, in the handwriting editing interface 16, and stores handwritten characters in advance. 30 is formed in the handwriting recognition dictionary 17 shown in FIG.
[0053]
The handwritten character recognition unit 29 compares the trajectory coordinates supplied from the trajectory coordinate extraction unit 21 with a plurality of basic character strokes stored in the handwritten character table 30, and corresponds to the closest basic character stroke. The character code is output from the handwritten character table 30 to the text editing unit 1a.
[0054]
A difference between such a handwritten character input function and the gesture editing function is that the handwritten character recognition unit 29 does not output position information. The handwritten character input function can be started up from an instruction from the keyboard 10 or an instruction from an icon on the display device 14, and is displayed on the tablet 19 of the display tablet 20 as shown in FIG. In addition, it is possible to start up from the gesture editing function by gesturing “Δ”.
[0055]
An operation example of such a handwritten character input function will be described. As shown in FIG. 11, when the handwritten character input function is started, a window 14b for handwritten character input is displayed at a predetermined position of the display tablet 20. In the first input area in the window 14a, a character is handwritten with, for example, “su” with the input pen 12.
[0056]
After that, when the input pen 12 is brought into contact with the adjacent second area for the next input, the character recognition of the locus coordinates handwritten in the first area is referred to the handwritten character table 30 as described above. It is executed by the handwritten character recognition unit 29 as described above, and the character as a result of the recognition is input and displayed at the position indicated by the cursor 14a.
[0057]
Thus, for example, a font such as a cursive font is stored in advance in the handwritten character table 30 and the cursive font is input by handwriting so that the cursive font in the handwritten character table 30 can be displayed and printed. Yes.
[0058]
Next, an operation example of the above configuration in the gesture editing function will be described with reference to the flowchart of FIG. 12. First, the tip of the input pen 12 is brought into contact with or pressed at a desired position on the display tablet 20, that is, down. Then, the coordinates at that time are indicated via the pen interface 13.
[0059]
On the other hand, for example, the function of the input pen 12 in the icon area or the pen button area in the display device 14 is a selection function. Therefore, the effective range of the gesture editing function as described above on the display tablet 20 is the tablet 19 area excluding the above-described areas.
[0060]
From this, in the tablet 19 in the display tablet 20, for example, as shown in FIG. 13, for example, priority is given to the effective area 19a in the tablet 19 and the gesture function in advance according to each screen used in the display tablet 20, for example. An invalid area 19b indicating an icon area and a pen button area 19c having priority over the gesture function are set.
[0061]
Therefore, when pen-down is executed as described above and the coordinate data signal is output to the locus coordinate extraction unit 21, first, the pen-down coordinate that is the contact coordinate of the first input pen 12 is detected (step 1, Hereinafter, the step is abbreviated as S), and the effective area coordinates are compared (S2). As a result, if the pen-down coordinates are outside the effective area coordinates, the gesture function becomes invalid and the gesture function ends.
[0062]
If the pen-down coordinates are within the effective area coordinates, the next step is to detect whether the pen-down area, which is one of the other factors prohibiting the gesture function, exists in the pen-down coordinates ( S3) If the pen-down coordinate is on the coordinate of the pen button area, the routine proceeds to the pen button processing routine (S4).
[0063]
On the other hand, if the pen-down coordinate is outside the coordinates of the pen button area, the pen-down coordinate is stored, and when the next coordinate data is input by the input pen 12, the coordinate data and the pen-down coordinate are obtained. In comparison, it is determined whether or not the input coordinates are continuous with respect to the pen-down coordinates, that is, that at least one of the X and Y coordinates is continuous for eight coordinates (S5).
[0064]
At this time, if each coordinate data is a continuous trajectory, the gesture function is turned on and the gesture ON flag is set (S6), and the input pen 12 passes outside the effective area of the gesture function, that is, through the icon area or the like. In addition, the icon instruction function of the input pen 12 in the icon area is stopped. If the determination at S5 is not a continuous trajectory, the routine proceeds to pointing processing routine (S7).
[0065]
Note that the above steps S5 and S6 may be reversed, that is, the gesture ON flag may be set first. In this case, when each coordinate data is not continuous, the routine shifts to the pointing processing routine. At that time, the gesture ON flag is reset.
[0066]
Thereafter, when a gesture operation, that is, an input operation of a predetermined image on the tablet 19 by the input pen 12 is performed and the contact between the input pen 12 and the tablet 19 is released, that is, the input pen 12 is raised, As shown in the flowchart of FIG. 14, first, it is determined whether or not the flag indicating that the gesture function is ON as described above is set (S11). If the flag is not set, It is determined that the input operation is unrelated to the gesture function, and the gesture function is terminated.
[0067]
If the flag is set, the gesture command determination unit 26 first uses the dedicated coordinate data memory for each coordinate data of the input pen 12 from the pen-down coordinate to the pen-up coordinate for recognition processing. Is normalized and stored (S12).
[0068]
Next, the recognition processing of each coordinate data is executed by the gesture command determination unit 26 (S13), and if the recognition is OK after comparison with the gesture command table 27 (S14), the recognition is performed. Each editing process according to the result is executed (S15), and the gesture editing is completed. If the recognition process cannot be recognized, the process proceeds to an error process (S16), and the gesture editing is finished.
[0069]
As described above, in the configuration of the above-described embodiment, when pen-up is performed, even if the pen coordinate is outside the effective area of the gesture function, gesture recognition can be performed if the gesture function is ON at that time. Furthermore, if the pen-down coordinates are within the effective area and outside the pen button area, the coordinates of the drawing trajectory following the pen-down coordinates are outside the effective area and within the pen button area. Thus, the coordinate data of the drawing trajectory is validated and the recognition process can be performed.
[0070]
Therefore, for example, as shown in FIG. 15, when the input pen (not shown) is down at point A, the above configuration is based on the drawing of the input pen after the down transition because point A is in the gesture effective area 19a. After the gesture function is turned on and the drawing with the input pen is completed, the up coordinate of the input pen becomes the point B, for example, even if the point B is outside the gesture valid area 19a, that is, the invalid area 19b, That is, the gesture is valid. The same is true even if each coordinate in the middle of the drawing locus becomes the invalid area 19b.
[0071]
However, for example, as shown in FIG. 16, when the input pen (not shown) is brought down at the point C outside the effective gesture area, that is, in the ineffective area 19a, the above-described configuration causes the gesture function to be turned off. Thus, for example, the process shifts to icon processing or the like.
[0072]
By the way, in the conventional gesture function, since it is determined whether or not the drawing is valid after the drawing is completed, the determination takes time, and the drawing with the input pen as described above is performed. If the input pen comes into contact with the invalid area outside the effective area of the gesture or the tablet area as the pen button area in the middle of the process, the process of the gesture function is stopped and the process proceeds to error processing.
[0073]
For this reason, conventionally, it is necessary to pay attention not only to the start of the operation but also to the operation completion until the operation of the input pen is performed, and it takes time to draw in the gesture function, and the operability is deteriorated.
[0074]
However, in the configuration of the above-described embodiment, if the pen-down coordinate by the input pen 12 is within the effective area 19a of the gesture function, the gesture function is started and the input pen 12 is enabled for the gesture while the input pen 12 is drawing. The drawing is valid even if it is outside the area 19a, that is, in contact with the invalid area 19b or the pen button area 19c.
[0075]
Thereby, since the above-mentioned configuration can start the gesture function by the pen-down coordinates, it is possible to prepare the call of the gesture command table 27 necessary for the gesture function in advance, so that the gesture function can be speeded up. In addition, during drawing with the input pen 12, there is no need to be particularly aware of the effective area, and the operability of the gesture function can be improved.
[0076]
Next, each operation in the command selection function in the gesture function will be described with reference to the flowchart of FIG. When the process of the command selection function is activated by an instruction signal from the input means such as the keyboard 10, first, the process function names of all recognizable commands are called (S21), and then the process function names are displayed. It is displayed on the display device 14 as a table item (S22).
[0077]
Subsequently, after valid / invalid is selected for each item by the execution key on the keyboard 10 (S23), whether or not the valid / invalid command is updated by key operation is set as shown in FIG. 19, for example (S24). ). At this time, when updating to a newly selected valid / invalid command, the execution key is turned ON, the selection data is taken in (S25), updated (S26), and the screen on the display device 14 is cleared ( S27), when the above process is completed, and when updating to the newly selected valid / invalid command is not performed, the screen on the display device 14 is cleared without turning on the release key and updating (S27), The process ends.
[0078]
Next, each operation in the registration / call processing in the command selection function will be described with reference to the flowchart of FIG. First, when the above registration / call processing is activated by an instruction signal from an input means such as the input pen 12 or the keyboard 10, it is first determined whether the registration processing or call processing (S31). All of the current valid / invalid command data is called to the display device 14 (S32), and after confirmation, the registered name is input from the keyboard 10 or the like (S33), and the valid / invalid command data is registered with the registered mate. The data is stored in the buffer 33 (S34), and the registration process is completed.
[0079]
On the other hand, if it is a call process in S31, after inputting and selecting a registered name (S35), the registered name in the registration buffer 33 is searched (S36), and valid / invalid command data corresponding to the registered name is obtained. Called and displayed on the display device 14 (S37), the valid / invalid command data so far is updated to the valid / invalid command data of the registered name (S38), and the calling process is completed.
[0080]
As described above, in the configuration of the above embodiment, the gesture function required by the user can be validated by enabling and disabling each command. Thereby, it is possible to prevent an erroneous operation due to recognition of unnecessary gesture functions, and further, it is possible to reduce the number of gesture commands recognized by the user, so that the user recognition rate of the commands can be increased.
[0081]
Therefore, the above configuration can reduce misrecognition of each command used for the gesture function, and enables more accurate editing processing according to the user's intention.
[0082]
Further, in the above configuration, when a plurality of users use the same information processing apparatus, it is possible to select whether the command is valid / invalid for each user, and to store, that is, register the selection contents. This makes it possible to arbitrarily select gesture functions that a plurality of users individually require at any time, and easily perform an editing process suitable for each user's editing method.
[0083]
In addition, the above configuration takes time to create sentences and the like caused by inadvertently editing with unnecessary gesture functions when the gesture functions necessary for individual users are changed every time the user changes. Can be reduced.
[0084]
Next, a mode selection process by valid / invalid grouping in the command selection function will be described with reference to FIG. When the above configuration is a gesture function, when an interrupt by a mode selection key is generated by the keyboard 10 or the input pen 12, etc., first, the processing function names of all commands that can be recognized are called, and then each processing function name is displayed. It is displayed on the display device 14 as a table item (S41).
[0085]
Subsequently, the execution key on the keyboard 10 is used to select valid / invalid for each item, and after setting the valid command group and invalid command group (S42), the valid / invalid commands so far are set as described above. Whether or not to update to the selected command is set by key operation (S43).
[0086]
At this time, when updating to a newly selected valid / invalid command, the execution key is turned ON, the selection data is taken in and updated (S44), the screen on the display device 14 is cleared (S45), On the other hand, if the mode selection process is not updated and the newly selected valid / invalid command is not updated, the release key is turned on and the screen on the display device 14 is cleared without updating (S45). Exit.
[0087]
As described above, in the above configuration, the invalid command in the gesture function can be set, so that erroneous recognition of the gesture command in the gesture function can be prevented as described above.
[0088]
In addition, the above-described configuration can, for example, disable gesture / erase commands and enable gesture editing by setting other commands to be valid. The possibility of erroneous deletion of the image is avoided. An example of such a partially valid gesture function selection screen is shown in FIG.
[0089]
Since it is possible to select a partly valid in this way, it is particularly effective for preventing a beginner who handles the gesture function from accidentally erasing an image such as a sentence on the display device 14, and is troublesome when operating the above configuration. It is possible to save the trouble of re-creating a sentence or the like, and to improve operability.
[0090]
In the above configuration, the screen information buffer 31 is provided, and when the gesture function is activated, as shown in the flowchart of FIG. 23, the image information on the display device 14 at that time is stored in the screen information buffer 31, that is, saved. (S51).
[0091]
Subsequently, the input pen 12 is lowered (S52), a command for instructing an editing function is input by the input pen 12 (S53), the recognition of the editing range is confirmed (S54, S55), and the input pen is determined. When 12 is up (S52), the command and editing range are output to the gesture command determination unit 26 (S56).
[0092]
Thereafter, the screen information obtained by saving the display screen of the display device 14 in the screen information buffer 31 is returned to the display screen (S57). Subsequently, a function such as an editing operation is executed on the screen information stored in the text memory 2a, and the result is displayed on the display device 14 (S58).
[0093]
Next, it is determined whether or not to cancel the display screen of the display device 14 (S59). If not cancelled, the above gesture function is completed. If cancelled, the screen saved in the screen information buffer 31 is canceled. The display screen of the display device 14 is returned to the information, and the screen information in the text memory 2a is also restored (S60).
[0094]
As described above, since the image information on the display device 14 immediately before the operation by the input pen 12 of the gesture function is stored in the screen information buffer 31 in the above configuration, the original function when the gesture function is canceled as described above. The return to the image can be speeded up.
[0095]
【The invention's effect】
In the gesture processing device and the gesture processing method of the present invention, the instruction is started on the display surface by the input means, that is, the gesture function is determined to be valid or invalid when the first coordinate is designated, and based on the subsequent stroke Since the edit command is extracted, accurate and quick processing of the gesture function of editing information displayed in the effective area can be performed when the gesture function is valid. In the gesture processing device and the gesture processing method of the present invention, even if the input unit passes the gesture invalid area while the stroke is instructed to an arbitrary position on the display screen by the input unit, the gesture function is not invalidated. Thus, there is an effect that it is possible to save the trouble of invalidating the gesture function as in the prior art and instructing again by the input means.
[Brief description of the drawings]
FIG. 1 is a principal block diagram of a gesture processing apparatus according to the present invention.
FIG. 2 is a block diagram of a gesture processing apparatus according to the present invention.
FIG. 3 is an explanatory diagram showing an example of basic stroke recognition in the gesture processing device of the present invention.
4A and 4B are explanatory diagrams showing position information on a display tablet of the gesture processing device of the present invention, in which FIG. 4A is a tablet, and FIG. 4B is a display surface of the display device.
FIG. 5 is an explanatory diagram showing a gesture function valid area and a gesture function invalid area in the display tablet of the present invention.
FIG. 6 is an explanatory diagram showing examples of basic strokes according to the present invention and commands corresponding to them.
FIG. 7 is an explanatory diagram showing examples of basic strokes according to the present invention and commands corresponding to them.
FIG. 8 is an explanatory diagram showing an editing operation example of a gesture function in the gesture processing apparatus of the present invention.
FIG. 9 is an explanatory diagram showing an example of each editing operation of the gesture function in the gesture processing device according to the present invention.
FIG. 10 is an explanatory diagram showing an operation example of a pointing function in the gesture processing apparatus of the present invention.
FIG. 11 is an explanatory diagram showing an operation example of a handwritten character input function in the gesture processing apparatus of the present invention.
FIG. 12 is a flowchart at the time of pen-down in the gesture function of the present invention.
FIG. 13 is an explanatory diagram showing a pen button area in the display tablet of the present invention.
FIG. 14 is a flowchart at the time of pen-up in the gesture function of the present invention.
FIG. 15 is an explanatory diagram showing an example of a locus on a display tablet in the gesture function of the present invention.
FIG. 16 is an explanatory diagram showing another example of the locus on the display tablet in the gesture function of the present invention.
FIG. 17 is an explanatory diagram showing a display example on a display tablet in the gesture function of the present invention.
FIG. 18 is a flowchart when setting the validity / invalidity of a call in the gesture function of the present invention.
FIG. 19 is an explanatory diagram showing a display example on the display device when setting validity / invalidity of a call in the gesture function of the present invention.
FIG. 20 is a flowchart for setting registration / calling in the gesture function of the present invention.
FIG. 21 is a flowchart for setting a mode in the gesture function of the present invention.
FIG. 22 is an explanatory diagram showing a display example on the display device when a mode of the present invention is selected.
FIG. 23 is a flowchart showing a method for saving image information in the gesture function of the present invention.
[Explanation of symbols]
12 Input pen
14 Display device
19 tablets
22 Gesture determination unit (determination means)

Claims (3)

Display means such as a liquid crystal display;
Coordinate extraction means for outputting strokes of continuous coordinates on the display surface of the display means designated by the input means such as an input pen;
Determining means for determining whether or not the display position corresponding to the first coordinates output from the coordinate extracting means is an effective area in which information to be edited is displayed;
Pointing processing means for moving the cursor to the first coordinate position determined to be an effective area by the determination means;
Strokes continuous to the first coordinates determined to be outside the effective area by the judging means are not taken in, but strokes consecutive to the first coordinates judged to be in the valid area are taken in and compared with the basic stroke stored in advance. Gesture recognition means for outputting an editing command corresponding to the approximate basic stroke;
A gesture processing apparatus comprising: editing means for editing information indicated by a cursor displayed in the effective area on the display means based on an edit command output from the gesture recognition means.   The gesture processing apparatus according to claim 1, wherein the determination unit is configured not to perform region determination on coordinates that are continuous with the first coordinate in the effective region. A gesture processing method in a gesture processing apparatus, comprising: display means such as a liquid crystal display; and coordinate extraction means for outputting a stroke of continuous coordinates on the display surface of the display means designated by an input means such as an input pen. ,
Determining whether the display position corresponding to the first coordinate output from the coordinate extraction means is a predetermined effective area in which information to be edited is displayed;
Strokes continuous to the first coordinate determined to be outside the valid area are not captured, and after moving the cursor to the first coordinate position determined to be the valid area, the first stroke determined to be the valid area Takes a series of strokes in the coordinates, compares them with the pre-stored basic strokes, and outputs an editing command corresponding to the basic stroke that is closest to
A gesture processing method for editing information indicated by a cursor displayed in the effective area on the display unit based on an output editing command.

Images