JP2005228353A - Display apparatus with touch panel, control method for display apparatus with touch panel, and program for executing the method on computer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display apparatus with a touch panel which is improved in operability and can progress a presentation smoothly. <P>SOLUTION: The display device with a touch panel for displaying figures drawn by using a touch panel comprises: a touch point trace detection part 120 for detecting a trace of touch points with respect to the touch panel; a stop touch detection part 122 for detecting stop touch when the touch point stays at the same position for over a specified period while detecting the touch point trace; a figure decision part 124 for deciding the figure shown by the trace detected by the touch point trace detection part 120; and a figure display part 126 for displaying the trace detected by the touch point trace detection part 120 to a display picture 113, deleting the track in display after the decision of the figure by the figure decision part 124 is completed, and displaying to a display picture the figure obtained as a result of decision. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display device with a touch panel in which a display screen and a coordinate input device are integrated, a control method for a display device with a touch panel, and a program for causing a computer to execute the method.

  Currently, a display device with a touch panel that integrates a display screen and a coordinate input device and can control an image displayed on the display screen while touching the display screen is becoming widespread. In addition, there is an increasing number of cases where a relatively large display device with a touch panel (size equivalent to a blackboard or whiteboard) is used for school classes or company presentations.

  The display device with a touch panel can write information in a displayed image while a speaker touches the display screen, or can enlarge a part of the displayed image. Therefore, it is possible to provide a presentation that is easy for the viewer to understand by using the presentation. In addition, since the displayed image can be changed or switched quickly, there is an advantage that the presentation can proceed smoothly (for example, see Patent Document 1).

JP 2003-330606 A

  By the way, it is often necessary to write not only letters but also graphics such as arrows, circles, and triangles during presentations. However, it is common to draw a figure using a figure drawing tool such as a pen or an eraser displayed on the display screen. In a large-sized display device with a touch panel, there are cases where a speaker cannot operate to draw a figure at a desired position by operating a tool for drawing a figure while standing at a certain position. In such cases, the speaker will cross the front of the display screen to manipulate the tool during the presentation.

  If the speaker crosses in front of the screen during the presentation, there is a possibility that both the speaker and the viewer lack the ability to concentrate and prevent the smooth progress of the presentation. It is also possible for speakers to be physically burdened during the presentation. In addition, the operability of the display device with a touch panel may be lowered because the speaker feels that drawing operation is troublesome.

  The present invention has been made to solve the above-described problems. Since a speaker can draw a figure at a desired position while standing at a certain position, the operability is high and the presentation is smoothly performed. An object is to provide a display device with a touch panel that can be advanced, a control method for a display device with a touch panel, and a program for causing a computer to execute the method.

  In order to solve the above-described problems and achieve the object, the invention according to claim 1 is a control method of a display device with a touch panel that displays a figure drawn using a touch panel on a display screen, Touch point trajectory display means for displaying on the display screen a trajectory of the continuous movement of the touch point indicating the position of the touch made with respect to the touch point without being released during the display of the touch point trajectory; A stop touch detection step of detecting a stop touch when the touch point is at one point for a predetermined time, a figure determination step of determining a figure indicated by a locus of the touch point when the stop touch is detected, and the figure determination A figure table that deletes the displayed trajectory and displays the figure obtained as a result of judgment on the display screen after the figure judgment in the process is completed. Characterized in that it comprises a step.

  According to the first aspect of the present invention, the locus of touch points made on the touch panel is displayed on the display screen. Then, when a stop touch is detected during the touch point detection, the figure indicated by the locus is determined. Further, after the graphic determination is completed, the displayed trajectory can be deleted and the graphic obtained as a result of the determination can be displayed on the display screen. For this reason, the operator can draw the figure based on the handwritten shape by handwriting the figure at the standing position and touching the stop as it is. Therefore, it is possible to draw a figure without moving at a desired position, and the presentation can proceed smoothly.

  The invention according to claim 2 is a control method of a display device with a touch panel that displays a figure drawn using a touch panel on a display screen, and is a continuous movement of a touch point indicating a position of a touch made on the touch panel. Touch point trajectory display step for displaying the trajectory on the display screen, and during the display of the touch point trajectory, the touch is not released and the touch is stopped when the touch point is at one point for a predetermined time or more. A stop touch detection step to detect, a graphic determination step for determining a graphic indicated by the locus of the touch point when the stop touch is detected, and a trajectory displayed after completion of the graphic determination in the graphic determination step The figure obtained as a result of the deletion is displayed on the display screen and is displayed if the figure cannot be determined. Characterized in that it comprises a graphic display step of deleting the locus, the.

  According to the second aspect of the present invention, the locus of touch points made on the touch panel is displayed on the display screen. Then, when a stop touch is detected during the touch point detection, the figure indicated by the locus is determined. Further, after the graphic determination is completed, the displayed trajectory can be deleted and the graphic obtained as a result of the determination can be displayed on the display screen. For this reason, the operator can draw the figure based on the handwritten shape by handwriting the figure at the standing position and touching the stop as it is. In addition, even when the figure cannot be determined, the handwritten figure can be deleted to make it easier to perform handwriting again. Therefore, it is possible to draw a figure without moving at a desired position, and the presentation can proceed smoothly.

  According to a third aspect of the present invention, the graphic display step displays again the trajectory detected in the touch point trajectory detection step when a drag operation is performed on the touch panel after the displayed trajectory is deleted. It is characterized by.

  According to the third aspect of the present invention, even when an unintended stop touch is made, the locus can be deleted, and the handwritten figure that was being drawn can be displayed again by a simple operation. For this reason, even when an unintended figure is determined, the figure can be easily drawn again.

  According to a fourth aspect of the present invention, the figure determining step includes a direction change detecting step of detecting a change in the direction of the locus of the touch point, and the locus is determined based on the change in the direction detected in the direction change detecting step. The figure to show is determined.

  According to the fourth aspect of the present invention, it is possible to determine the figure by a simple operation.

  The invention according to claim 5 is a control method of a display device with a touch panel for displaying a graphic drawn using a touch panel on a display screen, a touch point locus display step for displaying a handwritten graphic on the display screen, and a stop touch It includes a graphic determination step for detecting a position and determining a graphic indicated by the handwritten graphic, and a graphic display step for redisplaying the handwritten graphic after completion of the graphic determination in the graphic determination step.

  According to the fifth aspect of the present invention, the handwritten graphic is displayed on the display screen, the stop touch position is detected to determine the graphic indicated by the handwritten graphic, and after the determination of the graphic is completed, the handwritten graphic is displayed again. Even when the operator stops his hand for some reason and is unintentionally stopped, the handwritten figure can be displayed again on the display screen.

  The invention according to claim 6 is a control method of a display device with a touch panel for displaying a graphic drawn using a touch panel on a display screen, and a touch point for displaying a handwritten graphic made on the touch panel on the display screen A trajectory display step, a stop touch detection step of detecting a stop touch when the touch point is at one point for a predetermined time, and a touch of the touch point when the stop touch is detected by the stop touch detection step. It includes a graphic determination step for determining a graphic indicated by a locus, and a graphic display step for redisplaying the handwritten graphic after completion of the graphic determination in the graphic determination step.

  According to the sixth aspect of the present invention, when a handwritten figure made on the touch panel is displayed on the display screen and the touch point is at one point for a predetermined time or more, the stop touch is detected and the stop touch is detected. When detected, the figure indicated by the locus of the touch point is determined, and the handwritten figure is redisplayed after completion of the figure determination, so that the operator stops the hand for some reason and unintentionally stops touching. Even if it exists, a handwritten figure can be displayed on a display screen again.

  The invention according to claim 7 is characterized in that the graphic display step is redisplayed by dragging on a display screen.

  According to the invention described in claim 7, since the display is redisplayed by dragging on the display screen, even if the operator stops the hand for some reason and unintentionally makes a stop touch, The person can display the handwritten graphic again on the display screen by dragging without detaching.

  A program according to an eighth aspect of the present invention causes a computer to execute the control method for a display device with a touch panel according to any one of the first to seventh aspects.

  According to the invention described in claim 8, it is possible to cause a computer to execute the control method for a display device with a touch panel described in any one of claims 1 to 7.

  The invention according to claim 9 is a display device with a touch panel for displaying a figure drawn using a touch panel on a display screen, and a trajectory of a continuous movement of a touch point indicating a position of a touch made on the touch panel. Touch point trajectory display means for displaying on the display screen and stop detecting the touch when the touch point is not released and the touch point is at one point for a predetermined time or more while the touch point trajectory is being displayed. Touch detection means, and when the stop touch is detected, figure determination means for determining a figure indicated by the locus of the touch point; and after the figure determination by the figure determination means, the displayed locus is deleted. And graphic display means for displaying a graphic obtained as a result of the determination on a display screen.

  According to the ninth aspect of the invention, the locus of touch points made on the touch panel is displayed on the display screen. Then, when a stop touch is detected during the touch point detection, the figure indicated by the locus is determined. Further, after the graphic determination is completed, the displayed trajectory can be deleted and the graphic obtained as a result of the determination can be displayed on the display screen. For this reason, the operator can draw the figure based on the handwritten shape by handwriting the figure at the standing position and touching the stop as it is. Therefore, it is possible to draw a figure without moving at a desired position, and the presentation can proceed smoothly.

  The invention according to claim 10 is a display device with a touch panel that displays a figure drawn using a touch panel on a display screen, and shows a locus of continuous movement of a touch point indicating a position of a touch made on the touch panel. Touch point trajectory display means for displaying on the display screen and stop detecting the touch when the touch point is not released and the touch point is at one point for a predetermined time or more while the touch point trajectory is being displayed. Touch detection means, and when the stop touch is detected, figure determination means for determining a figure indicated by the locus of the touch point; and after the figure determination by the figure determination means, the displayed locus is deleted. The figure obtained as a result of the judgment is displayed on the display screen. If the figure cannot be judged, the displayed trajectory is displayed. A graphic display means for dividing, and further comprising a.

  According to the tenth aspect of the present invention, the locus of touch points made on the touch panel is displayed on the display screen. Then, when a stop touch is detected during the touch point detection, the figure indicated by the locus is determined. Further, after the graphic determination is completed, the displayed trajectory can be deleted and the graphic obtained as a result of the determination can be displayed on the display screen. For this reason, the operator can draw the figure based on the handwritten shape by handwriting the figure at the standing position and touching the stop as it is. In addition, even when the figure cannot be determined, the handwritten figure can be deleted to make it easier to perform handwriting again. Therefore, it is possible to draw a figure without moving at a desired position, and the presentation can proceed smoothly.

  In the invention according to claim 11, the graphic display means displays again the locus detected by the touch point locus detection means when a drag operation is performed on the touch panel after the displayed locus is deleted. It is characterized by.

  According to the eleventh aspect of the present invention, even when an unintended stop touch is made, the locus can be deleted, and the handwritten figure that was being drawn can be displayed again with a simple operation. For this reason, even when an unintended figure is determined, the figure can be easily drawn again.

  The invention according to claim 12 is a display device with a touch panel for displaying a graphic drawn using a touch panel on a display screen, a touch point locus display means for displaying a handwritten graphic on the display screen, and detecting a stop touch position And a graphic determination means for determining the graphic indicated by the handwritten graphic, and a graphic display means for redisplaying the handwritten graphic after the graphic determination by the graphic determination means is completed.

  According to the invention described in claim 12, since the handwritten graphic is displayed on the display screen, the stop touch position is detected to determine the graphic indicated by the handwritten graphic, and the handwritten graphic is displayed again after the graphic determination is completed. Even when the operator stops his hand for some reason and is unintentionally stopped, the handwritten figure can be displayed again on the display screen.

  The invention according to claim 13 is a display device with a touch panel for displaying a graphic drawn using a touch panel on a display screen, and a touch point locus display means for displaying a handwritten graphic made on the touch panel on the display screen. When the touch point is at one point for a predetermined time or more, a stop touch detection unit that detects a stop touch, and a locus of the touch point indicates when the stop touch is detected by the stop touch detection unit A graphic determination means for determining a graphic and a graphic display means for redisplaying the handwritten graphic after the graphic determination in the graphic determination means is completed.

  According to the thirteenth aspect of the present invention, a handwritten figure made on the touch panel is displayed on the display screen, and when the touch point is at one point for a predetermined time or more, the stop touch is detected, and the stop touch is detected. When detected, the figure indicated by the locus of the touch point is determined, and the handwritten figure is redisplayed after completion of the figure determination, so that the operator stops the hand for some reason and unintentionally stops touching. Even if it exists, a handwritten figure can be displayed on a display screen again.

  The invention according to claim 14 is characterized in that the graphic display means redisplays by dragging on the display screen.

  According to the invention described in claim 14, since the display is redisplayed by dragging on the display screen, even if the operator stops his hand for some reason and unintentionally stops touching, The person can display the handwritten graphic again on the display screen by dragging without detaching.

  The invention according to claim 1 provides a control method of a display device with a touch panel with high operability, which can draw a figure without moving at a desired position and can smoothly advance a presentation. There is an effect that can be done.

  The invention according to claim 2 enables drawing of a figure without moving at a desired position, and even when the figure cannot be determined, the handwritten figure is deleted so that handwriting can be easily performed again. It is possible to provide a method for controlling a display device with a touch panel with high operability, which can be performed smoothly.

  The invention described in claim 3 can provide a control method for a display device with a touch panel with high operability, which can easily redraw a graphic even when an unintended graphic is determined. Play.

  According to the fourth aspect of the present invention, there is an effect that it is possible to provide a control method for a display device with a touch panel with high operability that can determine a figure in a relatively short time.

  According to the fifth aspect of the present invention, even when the operator stops his hand for some reason and unintentionally makes a stop touch, the handwritten figure can be displayed again on the display screen.

  According to the sixth aspect of the present invention, there is an effect that even if the operator stops his hand for some reason and unintentionally makes a stop touch, the handwritten figure can be displayed again on the display screen.

  According to the seventh aspect of the present invention, even if the operator stops his hand for some reason and the stop touch is unintentionally, the operator can rewrite the handwriting on the display screen by dragging without detaching. There is an effect that a figure can be displayed.

  The invention according to claim 8 has an effect that the computer can execute the method for controlling the display device with a touch panel according to any one of claims 1 to 7.

  The invention according to claim 9 provides a control method of a display device with a touch panel with high operability, which can draw a figure without moving at a desired position and can smoothly advance a presentation. There is an effect that can be done.

  The invention according to claim 10 enables drawing of a figure without moving at a desired position, and even when the figure cannot be determined, the handwritten figure is deleted so that handwriting can be easily performed again. It is possible to provide a method for controlling a display device with a touch panel with high operability, which can be performed smoothly.

  The invention according to claim 11 is capable of providing a control method for a display device with a touch panel with high operability, which can easily redraw a graphic even when an unintended graphic is determined. Play.

  According to the twelfth aspect of the present invention, even when the operator stops his hand for some reason and unintentionally makes a stop touch, the handwritten figure can be displayed again on the display screen.

  The invention according to claim 13 has an effect that the handwritten figure can be displayed again on the display screen even when the operator stops his hand for some reason and unintentionally stops touching.

  According to the fourteenth aspect of the present invention, even when the operator stops his hand for some reason and the stop touch is unintentionally, the operator can perform handwriting again on the display screen by dragging without detaching. There is an effect that a figure can be displayed.

  Exemplary embodiments of a display device with a touch panel according to the present invention will be explained below in detail with reference to the accompanying drawings. FIG. 1 is a diagram for explaining a configuration of a display device with a touch panel according to the present embodiment. The illustrated display device with a touch panel controls the image data based on the touch panel type coordinate input device 1, the coordinate detection device 3 that detects the coordinates input to the coordinate input device 1, and the coordinates detected by the coordinate detection device 3. And a display device 2 for displaying image data (R, G, B) controlled by the host device 4 on a display screen such as a liquid crystal screen or a PDP (Plasma Display Panel). In the present specification, a configuration in which the coordinate input device 1 and the coordinate detection device 3 are combined is also referred to as a touch panel.

  In the display device with a touch panel according to the present embodiment, a display screen 113 is provided so as to overlap the coordinate input surface 112 of the coordinate input device 1, and the display device 2 displays image data on the display screen 113. The coordinate input surface 112 is an area where the coordinate detection device 3 can detect coordinates. The display device with a touch panel of the present embodiment is configured to directly touch the display screen 113, and the coordinate input surface 112 is a virtual surface.

  The coordinate input device 1 includes an optical detector, which will be described later, and optically detects that a finger, a pen, or the like touches (touches) or leaves the display screen 113. The data detected by the optical detector is input to the coordinate detection device 3, and the coordinate detection device 3 calculates the coordinates (x, y) of the point (touch point) t on the coordinate input surface 112 that has been touched. The calculated coordinates are represented by the number of pixels on the display screen 113 (for example, x: 1024, y: 768), and are periodically output to the coordinate detection device 3 at a time such as 10 ms or 20 ms. The calculation of the coordinates of the touch point of the coordinate detection device 3 will be described in detail later.

  The coordinate detection device 3 also includes a left optical detector I / F 101, a right optical detector I / F 102 for inputting data detected by an optical detector, which will be described later, and a central processing unit 104 that controls the coordinate detection device 3 in general. A ROM 105 storing a program used by the central processing unit 104, a RAM 106 temporarily storing work data of the central processing unit 104, and a timer (TIMER) for periodically measuring time and inputting to the central processing unit 104 107.

  The host device 4 is a PC (Personal Computer) and is equipped with a general-purpose OS such as Windows (registered trademark), MACOS (registered trademark), or Linux (registered trademark). Running under control. Then, the driver 108 which is a program (driver software) executed under the control of the general-purpose OS, the APL 111 which is one of the applications operating under the control of the common general-purpose OS, and the image data are temporarily stored. And an image RAM 115 stored in the storage.

  In the present embodiment, touching the coordinate input surface 112 with a finger or a pen is referred to as touch, and the touched point is referred to as a touch point. Also, the fact that the finger or the pen has moved away from the touch point (the touch has been released) is called detachment. Moreover, moving on the coordinate input surface 112 without touch being detached is called moving touch (drag). Furthermore, a touch detected continuously at the same touch point without being detached is referred to as the same position touch.

  In the same position touch determination, it is not necessary that the previous touch point and the current touch point exactly match each other, and the distance between the touch point between the previous touch and the current touch is equal to or less than a predetermined length. Good. The predetermined length is preferably about 1 to 3 points with a coordinate interval determined by the size of the display screen and the number of pixels as 1 point.

  FIG. 2 is a functional block diagram for explaining the configuration of the APL 111. The APL 111 is a state where the touch point trajectory detecting unit 120 detects the trajectory of the continuous movement of the touch point, and the touch point is at one point for a predetermined time or more without detaching during touch detection by the touch point trajectory detecting unit 120. A stop touch detection unit 122 that detects a stop touch, a graphic determination unit 124 that determines a graphic indicated by the locus detected when the stop touch is detected, and displays the detected locus on the display device 2 to complete the graphic determination. Thereafter, a graphic display unit 126 for deleting the displayed trajectory and displaying the graphic obtained as a result of the determination on the display screen 113 is provided.

  If the graphic determination unit 124 cannot determine a graphic, the graphic display unit 126 deletes the locus displayed on the display screen 113. Furthermore, the graphic display unit 126 detects that the touch point locus detection unit 120 detects that a drag operation (an operation to move the touch point without detaching after touching) is performed after the locus is deleted. The detected locus is displayed on the display screen 113 again. For this reason, in the present embodiment, it is assumed that the graphic display unit 126 includes a storage device (not shown) that stores the locus even after the locus on the display screen 113 is deleted.

  The configuration described above operates as follows. That is, when a touch is made on the coordinate input surface 112 of the coordinate input device 1, data indicating the touch point of the touch is output to the coordinate detection device 3. The coordinate detection device 3 calculates the coordinates of the touch point based on the data indicating the touch point. The coordinate data (coordinate data) calculated by the coordinate detection device 3 is delivered to the driver 108 of the host device 4 as detection data together with any information of touch, detach, move touch, and touch at the same position.

  For example, while the operator is drawing a handwritten graphic on the coordinate input surface 112, the touch point is continuously moved without being detached, and therefore, the touch is in a moving touch state. Further, when the drawing of the handwritten figure is finished and the finger or the like is stopped at the end point, the touch point is not moved without being detached, so that the touch position is in the same position.

  The driver 108 receives detection data from the coordinate detection device 3 via RS232C or USB, and receives the detected data as mouse data (mouse right button, center button, left button ON / OFF information and mouse clicked). The information of the coordinates of the selected point).

  The APL 111 receives detection data from the driver 108 as mouse data. Then, a function set in advance in association with coordinate data and button ON information included in the received mouse data is executed.

  The function here refers to, for example, character drawing, figure drawing, and ruled line drawing for drawing the locus of the touch point with a line of a specific color or thickness. Image data created by the APL 111 is developed in the image RAM 115 in a format represented by R, G, and B. The developed image data is sent to the display device 2. The display device 2 displays the image data on the display screen 113.

  Next, detection of touch points and calculation of coordinates in the display device with a touch panel of the present embodiment will be described. FIG. 3 is a diagram illustrating the coordinate input device according to the present embodiment. The coordinate input device 1 includes a rectangular coordinate input surface 112 having a vertical length H and a horizontal length W in the figure, a retroreflective member 201 provided on three sides of the coordinate input surface, The left optical detector 202 </ b> L and the right optical detector 202 </ b> R provided at both ends of one side where the reflective reflector 201 is not provided.

  Each of the left optical detector 202L and the right optical detector 202R is a unit in which a light source (not shown) that is a semiconductor laser and a light receiving unit (not shown) using, for example, a CCD (Charged Coupled Device) are integrated. It is. The light source irradiates light in a fan shape that requires the light source over the entire area of the coordinate input surface 112. The left optical detector 202 </ b> L and the right optical detector 202 </ b> R irradiate fan-shaped light, so that the laser light is irradiated on the entire coordinate input surface 112.

  The light irradiated on the coordinate input surface 112 is reflected by the retroreflection member 201. The retroreflective member 201 is a member that reflects light at an angle of 180 degrees. For example, the retroreflective member 201 reflects reflected light p1 shown in the drawing and reflects reflected light p2 passing through an optical axis parallel to the optical axis of the irradiated light p1. To do. When there is nothing blocking the light on the coordinate input surface 112, the left optical detector 202L and the right optical detector 202R receive all the reflected light of the irradiated light. However, for example, when a finger or pen touches the coordinate input surface 112, light passing through the touch point is not received by the left optical detector 202L and the right optical detector 202R.

  Information on the light detected by the left optical detector 202L and the right optical detector 202R is input to the coordinate detection device 3 as analog data. At this time, the coordinate detection device 3 includes the left optical detector 202L and the right optical detector from the optical axis of the light that should be originally received at the position where the light of the light receiving unit is not received among the light irradiated in a fan shape. Angles (light shielding angles) θL and θR between straight lines passing through the light receiving part 202R and straight lines passing through each light receiving part and the touch point t are obtained. The coordinates (x, y) of the touch point t are calculated as follows using the angles θL and θR.

x = W × tan θR / (tan θL + tan θR)
y = H−W × tan θL × tan θR / (tan θL + tan θR)

  Next, the format of detection data and the format of mouse data will be described with reference to FIGS. FIG. 4A is a diagram for explaining the format of detection data, and FIG. 4B is a diagram for explaining the format of mouse data.

  As shown in FIG. 4A, the detection data includes the x-coordinate and y-coordinate of the touch point, and information on the coordinate status of the touch point. The coordinate status indicates by 1 or 0 whether the detected data is a touch, a detach, a moving touch, or a touch at the same position. In the field indicating the movement touch and the same position touch, 1 is set in the state of either the movement touch or the same position touch. Whether the touch is a moving touch or a touch at the same position is determined by comparing the coordinates indicated by the current detection data with the coordinates indicated by the previous detection data.

  Further, as shown in FIG. 4B, the mouse data includes the x-coordinate and y-coordinate of the touch point, and the mouse status information. The mouse status indicates ON or OFF of the right button of the mouse and ON or OFF of the left button by 1 or 0. The touch, detach, move touch, and same-position touch are set in association with any one of ON / OFF of the right button of the mouse and ON / OFF of the left button. Thus, the mouse status is associated with information such as touch and detach in advance on the driver control panel of the host device 4. That is, the mouse status includes information corresponding to the coordinate status of the detection data.

  The mouse data generated as described above is transferred to the APL 111 of the host device 4. Next, functions related to determination of handwritten graphics in APL 111 will be described. As described with reference to FIG. 2, the APL 111 includes the touch point locus detection unit 120, the stop touch detection unit 122, the graphic determination unit 124, and the graphic display unit 126.

  The touch point locus detection unit 120 detects a handwritten figure, that is, a touch point locus, from the mouse data received from the driver 108. The stop touch detection unit 122 detects whether the mouse status of the mouse data received from the driver 108 indicates touch, detach, move touch, or same-position touch. The stop touch detection unit 122 also detects a stop touch when it receives mouse data indicating a touch at the same position for a predetermined movement time or longer. The end of drawing is recognized by detecting a stop touch. The stop touch detection unit 122 notifies the graphic determination unit 124 and the graphic display unit 126 of the detection result.

  When the stop touch detection unit 122 detects a stop touch, the figure determination unit 124 determines a figure indicated by the touch point locus detected by the touch point locus detection unit 120. A method for determining a graphic in the graphic determination unit 124 will be described later.

  The graphic display unit 126 causes the display screen 113 to display image data created from the touch point locus detected by the stop touch detection unit 122 while the stop touch detection unit 122 detects touch and touch movement. The graphic display unit 126 also causes the display screen 113 to display image data indicating the determined graphic when the graphic determination unit 124 succeeds in determining the graphic.

  Next, an algorithm by which the graphic determination unit 124 determines a graphic will be described with reference to FIGS.

  In the present embodiment, graphics determined by the graphic determination unit 124 are straight lines, arrows, triangles, quadrangles, circles, and ellipses. Among these, when drawing an arrow, a triangle, and a quadrangle, the drawing vector indicating the drawing direction of the handwritten figure is greatly changed in the middle of drawing. The graphic determination unit 124 detects the direction change and determines the shape of the handwritten graphic, that is, the touch point locus based on the detected direction change.

  FIG. 5 is a diagram for explaining a drawing vector used when the figure determining unit 124 determines the direction change. Hereinafter, a method for determining a change in direction will be described with reference to FIG.

The touch position detected last time is set as coordinates P (X, Y), and the touch position detected this time is set as coordinates R (X0, Y0). A value relating to a relative change in direction of the drawing vector (PR) with respect to the Q vector shown in FIG. 5 and a change value V are defined as follows.
X0 ≧ X, Y0 <Y, that is, when the previous coordinate P is the origin and the current coordinate R is in the area A,
V = (arctan ((X0−X) / (Y−Y0))) / N

X0 ≧ X, Y0 ≧ Y, that is, when the current coordinates are in the region B,
V = (arctan ((Y0−Y) / (X0−X))) / N + 90 / N

X0 <X, Y0 ≧ Y, that is, if the current coordinate is in the area C,
V = (arctan ((X−X0) / (Y0−Y))) / N + 180 / N

X0 <X, Y0 <Y, that is, when the current coordinate is in the region of D,
V = (arctan ((Y−Y0) / (X−X0))) / N + 270 / N

  By the way, when the direction of a drawing vector changes in drawing of an arrow, a triangle, and a rectangle, the drawing vector changes by about 90 ° or more with respect to the Q vector. Therefore, when there is a change in direction beyond this angle, it is determined that there has been a change in direction. In the present embodiment, 70 ° is set as the reference angle in the direction change determination. A determination value M is set based on the reference angle. Here, M = 70 / N (N is a unit of division in the drawing direction).

  When determining whether or not an arbitrary coordinate is accompanied by a change in direction in the touch point locus, the graphic determination unit 124 calculates a change value V of the drawing vector at the arbitrary coordinate. When V is M or more, it is determined that the direction has changed at an arbitrary coordinate. As described above, the graphic determination unit 124 can determine a straight line, an arrow, a triangle, and a quadrangle based on the direction change.

  FIG. 6A is a diagram illustrating a touch point locus 400 of a touch made on the touch panel 1. The drawing vectors at each point between the touch point (X0, Y0) and the detach point (X1, Y1) are always in substantially the same direction. Further, there is no specific rule for the direction change amount between the touch point and the detach point. As described above, when the direction of the drawing vector is always substantially constant and there is no rule in the amount of change in direction, the figure determination unit 124 determines the drawn touch point locus 400 as the straight line 402.

  Furthermore, when the difference between the X values (| X1−X0 |) and the difference between the Y values (| Y1−Y0 |) are not less than a predetermined value, the X axis and the Y axis It is determined that both are straight lines that are not parallel. The predetermined value is preferably about 5 points, for example.

  In the touch point locus 400 shown in FIG. 6A, the difference in the X value and the difference in the Y value at the touch point and the detach point are both equal to or greater than a predetermined value. Therefore, the touch point locus 400 is determined to be a straight line 402.

  The touch point locus 410 shown in FIG. 6B is determined to be a straight line in the same manner as the touch point locus 400 shown in FIG. However, in the touch point locus 410 shown in FIG. 6B, the difference between the X values at the touch point and the detach point is smaller than the determination value M. As described above, when the difference between the X values at the touch point and the detach point is smaller than the determination value M, the graphic determination unit 124 determines the touch point locus 410 as a horizontal line 412, that is, a straight line perpendicular to the X axis.

  When a horizontal line is to be input by touching, it is assumed that the horizontal line is shifted to some extent. Therefore, a change in the X value to a certain extent is regarded as an error, and in this case, it is determined as a horizontal line. For this reason, the operator can draw a horizontal line easily by touching roughly.

  Although not shown, the graphic determination unit 124 determines vertical lines in the same manner as horizontal lines. That is, when the Y value difference between the touch point and the detach point in the touch point locus determined as a straight line is smaller than the determination value, the straight line is determined as a vertical line.

  The touch point locus 420 shown in FIG. 7 includes a direction change point (X1, Y1) where the change value V of the drawing vector becomes greater than or equal to the determination value M between the touch point (X0, Y0) and the detach point (X2, Y2). Is included. As described above, when one direction change point is included, the graphic determination unit 124 determines the touch point locus 420 as the arrow 422. Specifically, it is determined as an arrow 422 having a touch point as a start point and a direction change point as an end point.

The touch point locus 430 shown in FIG. 8 includes two direction change points (X1, Y1) and (X2, Y2) between the touch point (X0, Y0) and the detach point (X0, Y0). In this case, the graphic determination unit 124 determines that the touch point locus 430 is a triangle 432. Specifically, when Y1> Y2, the triangle vertex is determined to be a triangle 432 having (X0, Y0), (X1, Y1), and (X, Y1) as vertices. here,
X = X0- (Y1-Y0) * (X0-X2) / (Y2-Y0)
It is. Here, X is derived from the following relational expression.
(Y1-Y0) / (X0-X) = (Y2-Y0) / (X0-X2)

  The touch point locus 440 shown in FIG. 9 has three direction change points (X1, Y1), (X2, Y2), (X3, Y3) between the touch point (X0, Y0) and the detach point (X0, Y0). Is included. In this case, the graphic determination unit 124 determines that the touch point locus 440 is a quadrangle 442. Specifically, it is determined as a quadrangle having the point (Xi, Yi), the point (Xm, Yi), the point (Xm, Ym), and the point (Xi, Ym) as vertices. Here, Xi is the minimum value of X0, X1, X2, and X3, Xm is the maximum value of X0, X1, X2, and X3, Yi is the minimum value of Y0, Y1, Y2, and Y3, and Ym is Y0, Y1 , Y2 and Y3 are minimum and maximum values.

The drawing vector of each point between the touch point (X0, Y0) and the detach point (X0, Y0) in the touch point locus 450 shown in FIG. 10A always changes in direction with a substantially constant change amount. . In this case, the graphic determination unit 124 determines the touch point locus 450 as a circle 452. Furthermore, the graphic determination unit 124 can recognize a circle and an ellipse. That is, the difference between (X1−X0) and (Y1−Y0) when the minimum X coordinate in the touch point locus is X0, the maximum X coordinate is X1, the minimum Y coordinate is Y0, and the maximum Y coordinate is Y1. A circle is determined only when is not more than double. Specifically, it is determined as a circle defined by the following equation.
Circle center point = ((X0 + X1) / 2), ((Y0 + Y1) / 2)
Circle diameter = ((X1-X0) + (Y1-Y0)) / 2

If the difference between (X1−X0) and (Y1−Y0) is more than double as in the touch point locus 460 shown in FIG. Specifically, it is determined as an ellipse 462 defined by the following equation.
Ellipse center point = ((X0 + X1) / 2), ((Y0 + Y1) / 2)
X-axis length of ellipse = (X1-X0) / 2
Ellipse Y-axis length = (Y1-Y0) / 2

  FIG. 11 shows a dialog box 500 displayed on the display screen 113 when setting drawing conditions. The dialog box 500 is activated by execution means such as a pull-down menu. The dialog box 500 includes a color setting box 510, a thickness setting box 512, a stop touch time setting box 514, a cancel button 516, and an OK button 518. The operator can set the color and thickness of a line to be displayed on the display screen 113 when drawing a graphic on the touch panel based on the display of the color setting box 510 and the thickness setting box 512. Further, a time until it is regarded as a stop touch can be set in the stop touch time setting box 514.

  Next, the control method of the display apparatus with a touch panel described above will be described using a flowchart. FIG. 12 is a flowchart for explaining control when the driver 108 converts detection data received from the coordinate detection device 3 into mouse data.

  When a touch with a finger or the like is detected in the coordinate input device 1, the driver 108 receives detection data from the coordinate input device 1 (S400). When the coordinate status of the received detection data is touch (S402: Yes), it is determined whether the touch operation corresponding to this detection data is a right click or a left click according to the preset setting of the driver control panel ( S414). When the touch operation is a right click (S414: Yes), the right button ON is set in the mouse status (S416). When the touch operation is left click (S414: No), the left button ON is set in the mouse status (S418).

  If the coordinate status of the received detection data is a moving touch or a touch at the same position (S404: Yes), the process proceeds to S414, and the right button ON or the left button ON is set in the mouse status as in the case of the touch coordinates. . In the present embodiment, the touch, the moving touch, and the same position touch are set in association with the left button ON.

  If the coordinate status of the received detection data is detach (S406: Yes), whether the touch operation corresponding to the detection data is to be right-clicked or left-clicked according to the preset driver control panel setting. Determine (S408). When the touch operation is a right click (S408: Yes), the right button OFF is set in the mouse status (S410). If left click is selected (S408: No), the left button OFF is set in the mouse status (S412). In the present embodiment, the detach is set in association with the left button OFF of the mouse data. With the above operation, the driver 108 converts detection data into mouse data every time it receives detection data.

  Next, control processing in the host device 4 will be described with reference to FIGS. 13 to 15 are flowcharts showing the control processing in the host device 4. FIG. 16 shows a screen displayed on the display screen 113 when the host apparatus 4 is performing control processing.

  As a default value, the state status is set to idle (S500). Note that when an execution right is given from the OS to handwritten drawing, that is, detection processing by the touch point locus detection unit 120, the host device 4 receives mouse data preferentially. When the APL 111 receives mouse data (S502: Yes), it is determined whether or not the mouse status indicates the right button. When the right button is indicated (S504: Yes), the process associated with the right button is executed (S506). The process executed at this time is, for example, control of a shortcut menu.

  When the left button is indicated (S504: No), the touch point locus detection unit 120 temporarily holds the coordinate data included in the mouse data (S510). Further, when the current status is idle (S512: Yes), drawing is set as the status (S514). Next, the stop touch detection unit 122 sets 0 for the same position touch time. That is, the same position touch time is cleared (S516). Thus, when the status status changes to drawing, preparations for detecting a stop touch are made.

  If the state status is not set to idle in S512 and the left button is OFF, that is, if it is detached (S512: No, S520: Yes), the state status is set to idle (S522). . Further, the coordinate data stored by the stop touch detection unit 122 is deleted (S524). Thus, the drawing mode is cleared.

  If the left button ON is set in S520 (S520: No), the process proceeds to S600. The processes after S600 will be described with reference to FIG.

  In S600, the coordinates of the previously acquired mouse data and the mouse data acquired this time are compared. When the coordinates in the previous mouse data and the current mouse data are equal (S600: Yes), the stop touch detection unit 122 adds 1 to the same position touch time (S602). As a result, when the same-position touch time has reached the stop touch time that serves as a reference for detection of the stop touch (S604: Yes), the figure determination unit 124 selects the touch point locus graphic detected by the touch point locus detection unit 120. Determination is made (S610).

  When the figure determination unit 124 succeeds in determining the figure (S612: Yes), the figure recognition is set as the status status (S620). Further, the graphic display unit 126 deletes the touch point locus displayed on the display screen 113, that is, the handwritten graphic (S622). Then, the determination graphic determined by the graphic determination unit 124 is displayed (S624). At this time, the display screen 113 is switched from the handwritten graphic shown in FIG. 16A to the determination graphic shown in FIG. In this way, when the operator touches the stop, the determination graphic is displayed. Further, when the operator detaches at this time, the processing from S502 to S524 is performed in order, and the determination figure is determined.

  In S612, when the figure determination fails (S612: No), the status status is set to “unrecognizable” (S614), and the graphic display unit 126 deletes the handwritten graphic (S616). At this time, the display screen 113 is switched from FIG. 16A to FIG.

  As described above, when the recognition of the handwritten graphic fails, the handwritten graphic is automatically deleted, so that the operator does not have to delete the handwritten character. If the operator further detaches at this time, the processing from S502 to S524 is performed in order, and the erasure of the handwritten figure is confirmed.

  If it is determined in S600 that the coordinates of the previous mouse data and the current mouse data are different (S600: No), the process proceeds to S700. The processes after S700 will be described with reference to FIG.

  In S700, the stop touch detection unit 122 sets 0 for the same position touch time. Thus, while the coordinates of the touch point are moving, the same-position touch time is not counted because the handwritten figure is being drawn.

  Next, when drawing is set for the current status (S702: Yes), the graphic display unit 126 displays a line between the coordinates indicated by the previous mouse data and the coordinates indicated by the current mouse data. (S704). Thus, while the handwritten graphic is being drawn, a line corresponding to the touch point is displayed on the display screen 113.

  Further, when graphic recognition is set as the status status (S702: No, S710: Yes), drawing is set as the status status (S712). In this case, the graphic display unit 126 deletes the determination graphic currently displayed on the screen (S714). Furthermore, the touch point locus corresponding to the erased determination graphic is displayed again on the display screen 113 (S716). At this time, the display screen 113 is switched from the handwritten figure shown in FIG. 16B to FIG.

  Thus, even after displaying the determination graphic, the handwritten graphic can be displayed again. Therefore, even if the operator stops his hand for some reason and the stop touch is unintentionally, the operator can display the handwritten graphic again on the display screen 113 by dragging without detaching. it can.

  If the status status is set to “unrecognizable” (S702: No, S710: No, S720: Yes), drawing is set as the status status (S724). In this case, the graphic display unit 126 displays the handwritten graphic on the display screen 113 (S726). At this time, the display screen 113 is switched from the screen shown in FIG. 16D to the handwritten figure shown in FIG.

  Thus, even after the figure determination fails and the handwritten figure is erased, the handwritten figure can be displayed again by dragging without detaching.

The control processing of the display device with a touch panel described above is recorded in a computer-readable recording medium such as a CD-ROM, a floppy (registered trademark) disk (FD), and a DVD as a file in an installable or executable format. To be provided.

It is a figure for demonstrating the structure of the display apparatus with a touchscreen of this Embodiment. It is a functional block diagram for demonstrating the structure of APL of this Embodiment. It is a figure which shows the coordinate input device shown in FIG. It is a figure for demonstrating the format of the detection data of this Embodiment, and the format of mouse data. It is a figure for demonstrating the drawing vector utilized when determining the direction change of this Embodiment. It is a figure which shows the touch point locus | trajectory of the touch of this Embodiment. It is a figure for demonstrating drawing of the arrow line of this Embodiment. It is a figure for demonstrating the drawing of the triangle of this Embodiment. It is a figure for demonstrating drawing of the rectangle of this Embodiment. It is a figure for demonstrating drawing of the circle | round | yen and an ellipse of this Embodiment. It is a figure which shows the image displayed on the display screen 113 when setting drawing conditions. It is a flowchart for demonstrating control when the driver 108 converts data from detection data to mouse data. 4 is a flowchart for explaining control processing in a host device 4; It is a flowchart for demonstrating the process after S600 following the control process shown in FIG. It is a flowchart for demonstrating the process after S700 following the control process shown in FIG. FIG. 11 is a diagram showing a screen displayed on the display screen 113 when control processing is being performed in the host device 4.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Coordinate input apparatus 2 Display apparatus 3 Coordinate detection apparatus 4 Host apparatus 104 Central processing unit 108 Driver 112 Coordinate input surface 113 Display screen 120 Touch point locus detection part 122 Stop touch detection part 124 Graphic determination part 126 Graphic display part 201 Retroreflection Member 202R Right optical detector 202L Left optical detector 400, 410, 430, 440, 450, 460 Touch point locus 402 Straight line 412 Horizontal line 422 Arrow 432 Triangle 442 Rectangle 452 Circle 462 Ellipse 500 Dialog box 510 Color setting box 512 Thickness setting Box 514 Stop touch time setting box 516 Cancel button 518 OK button

Claims (14)

A control method for a display device with a touch panel that displays a figure drawn using a touch panel on a display screen,
A touch point locus display step for displaying a locus of continuous movement of touch points indicating a position of a touch made on the touch panel on a display screen;
A stop touch detection step of detecting a stop touch when the touch point is not released during the display of the touch point locus and the touch point is at one point for a predetermined time or more;
A graphic determination step of determining a graphic indicated by the locus of the touch point when the stop touch is detected;
After the completion of the graphic determination in the graphic determination step, the graphic display step of deleting the displayed trajectory and displaying the graphic obtained as a result of the determination on the display screen;
A control method for a display device with a touch panel, comprising: A control method for a display device with a touch panel that displays a figure drawn using a touch panel on a display screen,
A touch point locus display step for displaying a locus of continuous movement of the touch point indicating the position of the touch made on the touch panel on the display screen;
A stop touch detection step of detecting a stop touch when the touch point is not released during the display of the touch point locus and the touch point is at one point for a predetermined time or more;
A graphic determination step of determining a graphic indicated by the locus of the touch point when the stop touch is detected;
After completion of the graphic determination in the graphic determination step, the displayed trajectory is deleted and the graphic obtained as a result of the determination is displayed on the display screen. If the graphic cannot be determined, the displayed trajectory is displayed. A graphic display process to be deleted;
A control method for a display device with a touch panel, comprising:   2. The trajectory detected in the touch point trajectory detection step is displayed again when the drag operation is performed on the touch panel after the displayed trajectory is deleted. 3. A control method for a display device with a touch panel according to 2.   The figure determination step includes a direction change detection step of detecting a change in the direction of the locus of the touch point, and the figure indicated by the locus is determined based on the change in the direction detected in the direction change detection step. The control method of the display apparatus with a touchscreen as described in any one of Claims 1-3. A control method for a display device with a touch panel that displays a figure drawn using a touch panel on a display screen,
Touch point locus display process for displaying handwritten figures on the display screen;
A graphic determination step of detecting a stop touch position and determining a graphic indicated by the handwritten graphic;
A graphic display step for redisplaying the handwritten graphic after completion of the graphic determination in the graphic determination step;
A control method for a display device with a touch panel, comprising: A control method for a display device with a touch panel that displays a figure drawn using a touch panel on a display screen,
A touch point locus display step of displaying a handwritten figure made on the touch panel on a display screen;
A stop touch detection step of detecting a stop touch when the touch point is at one point for a predetermined time or more;
When a stop touch is detected by the stop touch detection step, a graphic determination step for determining a graphic indicated by the locus of the touch points;
A graphic display step for redisplaying the handwritten graphic after completion of the graphic determination in the graphic determination step;
A control method for a display device with a touch panel, comprising:   The method for controlling a display device with a touch panel according to claim 5 or 6, wherein the graphic display step displays the display again by dragging on the display screen.   A program for causing a computer to execute the method for controlling a display device with a touch panel according to any one of claims 1 to 7. A display device with a touch panel for displaying a figure drawn using a touch panel on a display screen,
Touch point trajectory display means for displaying a trajectory of continuous movement of a touch point indicating a position of a touch made on the touch panel on a display screen;
Stop touch detection means for detecting a stop touch when the touch point is not released during the display of the touch point locus and the touch point is at one point for a predetermined time or more;
A graphic determination means for determining a graphic indicated by the locus of the touch point when the stop touch is detected;
After the completion of the graphic determination in the graphic determination means, graphic display means for deleting the displayed locus and displaying the graphic obtained as a result of the determination on the display screen;
A display device with a touch panel. A display device with a touch panel for displaying a figure drawn using a touch panel on a display screen,
Touch point trajectory display means for displaying a trajectory of continuous movement of a touch point indicating a position of a touch made on the touch panel on a display screen;
Stop touch detection means for detecting a stop touch when the touch point is not released during the display of the touch point locus and the touch point is at one point for a predetermined time or more;
A graphic determination means for determining a graphic indicated by the locus of the touch point when the stop touch is detected;
After the figure determination by the figure determination means, the displayed locus is deleted and the figure obtained as a result of the determination is displayed on the display screen. If the figure cannot be determined, the displayed locus is displayed. Graphic display means to be deleted;
A display device with a touch panel.   The graphic display means displays again the locus detected by the touch point locus detection means when a drag operation is performed on the touch panel after deleting the displayed locus. 10. A display device with a touch panel according to 10. A display device with a touch panel for displaying a figure drawn using a touch panel on a display screen,
Touch point locus display means for displaying a handwritten figure on a display screen;
Graphic determination means for detecting a stop touch position and determining a graphic indicated by the handwritten graphic;
A graphic display means for redisplaying the handwritten graphic after the graphic determination in the graphic determination means;
A display device with a touch panel. A display device with a touch panel for displaying a figure drawn using a touch panel on a display screen,
Touch point locus display means for displaying a handwritten figure made on the touch panel on a display screen;
A stop touch detection means for detecting a stop touch when the touch point is at one point for a predetermined time or more;
A figure determining means for determining a figure indicated by the locus of the touch point when a stop touch is detected by the stop touch detecting means;
A graphic display means for redisplaying the handwritten graphic after the graphic determination in the graphic determination means;
A display device with a touch panel.   The display device with a touch panel according to claim 12 or 13, wherein the graphic display means redisplays by dragging on the display screen.

Images