JP5651358B2 - Coordinate input device and program - Google Patents

Description

  The present invention relates to a coordinate input device arranged on the surface of a display screen or a projection screen. For example, the present invention relates to a coordinate input device and a program for detecting a click event based on an input object down operation and an up operation on an operation input surface.

  Conventionally, a device for inputting operation coordinates of a finger or an electronic pen on an operation screen generated by a computer or other screen generation device has been put into practical use. In this specification, this type of device is referred to as a coordinate input device.

  Conventionally, there is an electronic board system as one of the devices to which the coordinate input device is applied. In the electronic board system, it is possible to draw on the operation screen a character object or an image object (for example, composed of lines of various colors and thickness) reflecting the locus of the operation input detected by the coordinate input device. . In the electronic board system, an object on the operation screen can be operated through an operation input on the operation screen. In addition, the electronic board system can issue an event to a computer system operating in cooperation with the operation screen through an operation input accompanied by a specific movement.

  Today, electronic board systems are mainly used in fields such as conferences and education. For example, it is used to share information among multiple people by projecting data on a large electronic board. In addition, on the electronic board, writing of characters and other objects with an electronic pen or the like and enlargement display of display contents can be easily performed from the display screen. In this way, the electronic board uses a human natural motion for operation input. For this reason, a more effective presentation is possible compared with the case where a slide or the like is simply displayed.

  There are various types of electronic board systems. There are two types of display methods of typical operation screens, a front type and a rear type. In the front type, for example, a configuration in which a liquid crystal projector is disposed on the front side of the screen is employed, and a projection image of the liquid crystal projector is projected onto the screen. In the rear type, for example, a configuration in which a coordinate input device is arranged on the front side with respect to a plasma display or a liquid crystal display is adopted. In addition, there are a method using an electronic pen, a method using an operator's hand, a method using a stylus (pointer) as a means for operation input.

  Some electronic board systems connect an electronic board and a personal computer via a cable. In this case, the electronic board transmits operation input information on the operation input surface (for example, contact of an electronic pen or a finger or movement in a contact state) to the personal computer, and the personal computer replaces the information with a mouse event. The method of processing is taken.

  However, when the mouse is operated and when the operation input of the electronic board is converted into a mouse event, the generated mouse event is not the same. The possible reasons are listed below.

(1) When using the mouse, the operator positions the arm with his arm pressed against the desk only by the movement of the hand, and inputs a click or double-click only by the movement of the fingertip. On the other hand, in the case of an electronic board system, the operator performs an operation input while standing. That is, an operation input is performed with an unstable posture. For this reason, the operator's arm cannot be fixed. Further, the operator needs to move the entire hand for an operation (down operation) of pressing the electronic pen against the operation input surface. For this reason, it is difficult for the operator to click the aimed position. Moreover, this problem is not limited to the case of using a hand or an electronic pen. For example, when a pointer is used for operation input, hand shake is amplified by the length of the pointer, and the problem becomes more serious.

(2) In the case of the front type in which the computer screen is projected from the upper front side of the screen, the position to be operated overlaps with the shadow of the operator's hand. For this reason, it is difficult to determine the target position.

(3) When using an electronic board system in a meeting or education, the operator must operate from a diagonally forward position, not from the front of the electronic board, so as not to interfere with the visibility of conference participants, students and children. To do more. For this reason, parallax occurs, and a difference is easily generated between the coordinates that the operator intends to operate and the coordinates that are actually operated.

(4) The operator is operating when the calibration operation for matching the range projected on the computer screen with the recognition range of the digitizer (coordinate input device) has not been executed or the execution itself is insufficient. Deviation tends to occur between the intended coordinates and the actual operating coordinates.

  An object of the present invention is to provide a technique capable of solving the problem that an intended mouse event cannot be generated from an electronic board system (for example, an event such as a click or a double click cannot be generated) for the reasons described above. .

  The present inventors propose a coordinate input device capable of detecting an operation input on a displayed or projected operation screen having a processing function shown in the following (a) to (f).

(a) Processing function for storing detected events in the storage area
(b) A processing function that converts events stored in the storage area into mouse events as they are when a down operation event has continued for a certain period of time since the start of the detection.
(c) Processing function that converts events stored in the storage area into mouse events as they are when the event of the down operation has continued for a certain distance from the start of the detection
(d) Processing function to determine whether the first click event is detected when an up event is detected without satisfying any of the conditions
(e) If it is determined that the first click operation is detected when an up event is detected, a mouse event having an up coordinate at the same coordinate as the down coordinate detected immediately before is generated only for the event at the start of detection of the down operation. Processing function that discards events stored between the time of detection of down operation and the time of detection of up operation
(f) Processing function for recording detected click position and detection time in storage area In addition to the processing functions (a) to (f) described above, the coordinate input device has the following processing function (g). Suggest a thing.
(g) When it is determined that the second click operation is detected when the up event is detected, a mouse event having the down coordinate and the up coordinate of the second click operation is generated at the first click position, and from the time when the down operation is detected. Processing function for discarding events stored up to the time of detection of the up operation In addition to the processing functions (a) to (f) described above, the coordinate input device has the following processing functions (h) and ( Propose one with i).
(h) Processing function that converts an event stored between the detection of the second down operation and the detection of the up operation into a mouse event as it is when it is determined that the second click operation is detected when the up event is detected
(i) Processing function that automatically generates two mouse events each having a down coordinate and an up coordinate at the same coordinates as the mouse event generated for the second click operation.

  ADVANTAGE OF THE INVENTION According to this invention, the recognition rate by the side of the computer with respect to the click operation with respect to the displayed or projected operation screen and a double click operation can be raised.

1 is a system configuration diagram showing an embodiment of an electronic board system according to the present invention. The figure explaining the movement of the hand in the case of operating a mouse | mouth. The figure explaining the movement of the hand in the case of operating an electronic pen. The figure explaining the phenomenon which arises when the button arrange | positioned on the operation screen of an electronic board system is clicked with an electronic pen. The figure which shows a mode that the operation screen of an electronic board system is operated using the indicator stick. The figure explaining the usage example of the electronic board system in the place of a meeting or an education. The figure explaining the usage example of the electronic board system in the place of a meeting or an education. The figure explaining the block configuration of a detection coordinate transformation apparatus. The flowchart explaining the example of embodiment of the detection coordinate transformation program which concerns on this invention. The flowchart explaining the processing content at the time of an up event detection. The flowchart which replaces a part of processing content at the time of an up event detection.

  Embodiments of the invention will be described below with reference to the drawings. Note that all of the embodiments described below are examples, and the present invention includes a system realized by combining arbitrary functions described in the present specification, and some functions described in the present specification with well-known techniques. Also included are replacement systems and systems that add well-known techniques to the functions described herein. The functions executed in the embodiments described later are realized as programs executed on a computer (computer). However, part or all of the program may be realized through hardware.

(Configuration of electronic board system)
FIG. 1 shows an embodiment of an electronic board system. The electronic board system shown in FIG. 1 includes a projection surface 101, a coordinate input device 102, an electronic pen 103, an operation screen projection device 104, a control computer 105, a keyboard 106 attached to the control computer 105, and a display device 107. Yes.

  The projection surface 101 is a screen or whiteboard on which an operation screen is projected from the operation screen projection device 104. However, a display device such as a flat display may be used instead of the projection surface 101. In this case, since the operation screen is displayed on the display device, a system configuration in which the operation screen projection device 104 is not used is also conceivable. When a display device is used for displaying an operation screen, generally, a display device integrated with the coordinate input device 102 is used. Further, the operation screen is not limited to a large screen such as a screen or a whiteboard, but may be a small area such as a display screen used for a mobile phone, an electronic book, or other portable terminals.

  The coordinate input device 102 is a device that detects an operation input of the electronic pen 103 within the input area 108 and outputs the coordinates to the control computer 105. The input area 108 here corresponds to the display area of the operation screen projected by the operation screen projection device 104. The display content of the operation screen is the same as the display content of the display device 107.

  In the case of the electronic board system shown in FIG. 1, the coordinate input device 102 is arranged at the upper left corner position on the near side with respect to the projection plane 101. In the embodiment, infrared rays and ultrasonic waves are output from the pen tip from the electronic pen 103. Therefore, the coordinate input device 102 is equipped with an infrared sensor and an ultrasonic sensor.

  In addition, there is a coordinate input device 102 capable of detecting an operation input other than the dedicated electronic pen 3. This type of coordinate input device 102 irradiates light parallel to the projection plane 101 and detects the position where the input object (finger or stylus pen) blocks the light using the principle of triangulation. . In the case of this type of coordinate input device, for example, two light sources (for example, an infrared light source) and an image sensor (imaging device) are arranged near both ends of the upper side of the frame shape or near the center of the upper side. Each light source emits or scans a light beam over the entire range of the side located on the side opposite to the side where the light source is disposed and the entire range of the lower side. A retroreflective member is disposed on the inner side of the frame (opposite surface of the light beam) on the three sides excluding the upper side. For this reason, the incident light is reflected in the same direction as the incident direction. The reflected light is received by an image sensor arranged in the vicinity of the light source.

  In this embodiment, the coordinate input device 102 outputs operation input information as packet data for each frame (detection unit). In the case of this example, the information related to the operation input includes detection time, detected object number information, and detected object coordinate information. When there is no object on the operation input surface, the detected object number information is “0”, and when the presence of an object is detected, the detected object number information is “1”. In addition, when it corresponds to the function which can detect several operation input simultaneously, the detected object number information can take a numerical value of 2 or more. The coordinate information is given as a coordinate value with respect to a preset reference point, where the horizontal direction of the projection plane is the X axis and the vertical direction is the Y axis. Coordinate information is output by the number of detected objects. In addition, when it has a function of detecting the size of an object used for operation on the operation input surface, the detected size information is also output.

  The operation screen projection device 104 is used to project characters and objects input to the projection plane 101 through the operation screen and input objects. In the case of this embodiment, it is assumed that the operation screen projection device 104 is disposed at a front upper position with respect to the projection plane 101. However, the operation screen projection device 104 may be arranged on the right side, the left side, or the lower side with respect to the projection plane 101, or may be arranged on the back side with respect to the projection plane 101.

  The control computer 105 has a function equivalent to that of a general-purpose personal computer, and the internal memory stores a detected coordinate conversion program 1051 that matches the coordinates detected by the coordinate input device 102 with the indicated position on the operation screen. ing. In addition, the internal memory stores an event generation program for generating an event corresponding to an input object up operation, a down operation, and other operations on the operation input surface, and a display control program for processing the display of character objects and image objects. The

  As part of the detected coordinate conversion program 1051, coordinate conversion processing related to the click operation and the double click operation proposed by the inventors is executed. However, the function corresponding to the program can be executed in the coordinate input device 102 or can be implemented in the operation screen projection device 104. The implementation of the function may be in the form of hardware (for example, a semiconductor integrated circuit or a processing board) or a program (for example, firmware or an application).

(Human body movement during operation input)
FIG. 2 shows the movement of the hand 202 when operating the mouse 201. In this case, the click event can be generated only by the movement of the fingertip of the hand 202 holding the mouse 201.

  FIG. 3 shows the movement of the hand (forearm) 302 when operating the electronic pen 301. As shown in the figure, a click event can be generated by moving the entire hand (forearm) 302 having a 301 electronic pen.

  FIG. 4 shows the state of the screen when a click event is to be generated by hitting a button 402 constituting the operation screen 401 with the electronic pen 404. In this embodiment, since the operation screen projection device 104 is positioned on the near side with respect to the projection plane 101, when the electronic pen 404 is brought close to the button 402 constituting the operation screen 401, the shadow of the electronic pen 404 and the hand 405 is shadowed. The button 402 overlaps.

  FIG. 5 shows a state of a screen when a click event is about to be generated by hitting a button 503 constituting the operation screen 502 using the instruction bar 501. When the instruction bar 501 is used, the influence of the shadow is reduced because the click operation can be performed from a position away from the projection plane 101. However, the operation is performed by grasping one end side of the pointing rod 501 with a hand. For this reason, the movement of the hand movement is amplified on the other end side (tip end portion) of the pointing rod 501.

(Example of using electronic board system)
FIG. 6 shows an example of use of the electronic board system in a conference or education site. 6 and 7 show usage examples of the electronic board system. 6 and 7, the operation screen projection devices 603 and 703 and the conference participants and students / children 604 and 704 are located in front of the projection surfaces 606 and 706 to which the coordinate detection devices 601 and 701 are attached. FIG. 6 shows an example in which the operator 602 stands in front of the projection plane 606 and uses the electronic pen 604. In this case, the operator 602 hinders the visibility of the conference participants. Therefore, generally, as shown in FIG. 7, the operator 702 operates the electronic pen 705 obliquely in front of the projection plane 703. In this case, the operator 702 does not hinder the visibility of the conference participants. However, the operation from diagonally forward increases the distance from the standing position to the projection surface, and the click operation becomes difficult due to the influence of parallax and hand shake.

(Block configuration of detected coordinate conversion device)
FIG. 8 shows a functional block configuration of a detection coordinate conversion apparatus realized by the detection coordinate conversion program 1051 stored in the internal memory of the control computer 105. However, a circuit corresponding to the functional block configuration can be mounted on an electronic substrate or a semiconductor integrated circuit.

  The detected coordinate conversion apparatus includes an input information analysis unit 801, an execution function control unit 802, and an input information storage unit 803. The input information analysis unit 801 decomposes the input data 800 output from the coordinate detection apparatus 102 into detection time, detected object number information, and coordinate information.

  Based on the extracted input information (decomposed information) and the history of input information stored in the input information storage unit 803, the execution function control unit 802 notifies the user through the display device 107 and the operation screen projection device 104. Drawing information for the operation screen to be presented is generated. Further, the execution function control unit 802 executes a processing operation for storing newly extracted input information in the input information storage unit 803 as the latest history information. The execution function control unit 802 realizes an auxiliary function of a click operation and a double click operation. Details of the processing operation will be described later.

(Outline flowchart of display content control program)
FIG. 9 shows a flowchart corresponding to the detected coordinate conversion processing operation executed as a function of the execution function control unit 802. As described above, the processing operation of the execution function control unit 802 is executed as a part of the program function. Hereinafter, the processing of the execution function control unit 802 will be described.

  First, the execution function control unit 802 determines whether or not the generated event is a down event that occurs when the electronic pen is pressed against the operation input surface (step 901). If it is determined as a down event, the execution function control unit 802 stores the event in the input information storage unit 803 (step 902).

  On the other hand, if it is determined in step 901 that the event is not a down event, the execution function control unit 802 determines whether the generated event is an up event that occurs when the electronic pen is released from the operation input surface (step 903). If it is determined that the event is an up event, the execution function control unit 802 performs an up process (step 904). Details of this up process will be described with reference to FIG.

  Furthermore, when it is determined in step 903 that the event is not an up event, the execution function control unit 802 determines whether the event is being stored (step 905). When it is determined that the event is being stored, the execution function control unit 802 has a constant time difference from the storage start time to the time information of the input information and a distance between the coordinate information at the start of storage and the coordinate information of the input information, respectively. It is determined whether it is within the range (step 906). If both are within a certain range, the execution function control unit 802 also stores the event currently being processed (step 907).

  If it is determined in step 906 that either the elapsed time or the moving distance is not within the predetermined range, the execution function control unit 802 determines that the current event is an event related to a double click even if it is an event related to a click. However, it is not considered. That is, the execution function control unit 802 converts the stored event into a mouse event as it is (step 908). Thereafter, the execution function control unit 802 ends the event storage (step 909). As a result, subsequent events are processed in real time.

  If it is determined in step 905 that the event is not being stored, the execution function control unit 802 determines that the event has occurred after the processing in step 909. Therefore, the execution function control unit converts the input event into a mouse event in real time (step 910).

(Detailed operation of up process)
FIG. 10 describes the detailed contents of the processing operation executed in the up processing 904 (FIG. 9).

  First, the execution function control unit 802 determines whether an event up to immediately before the up process is being stored (step 1001). That is, it is determined whether it is within a certain time from the start of the down event and the tip position of the electronic pen is within a certain range.

  Here, when it is determined that storage is in progress, the execution function control unit 802 determines whether or not the counter value of the number of clicks is not equal to the initial value (step 1002).

  When it is determined that it is not equal to the initial value (when at least one click has occurred), the execution function control unit 802 determines the time difference between the time when the first click is detected and the current time, It is determined whether or not the distance between the coordinate value at the time of detecting the click and the current coordinate value is within a certain range (step 1003). The determination threshold here is set to an appropriate value in consideration of practical determination accuracy. Note that the determination threshold value is preferably variable in consideration of the usability of the user of the electronic board system.

  If it is determined in step 1003 that both the time difference and the distance are within a certain range, the execution function control unit 802 determines that a double click has occurred. In this case, the execution function control unit 802 generates a mouse event corresponding to the second down event and the up event at the position where the first down event is generated (step 1004).

  In the case of an electronic board system, the coordinates at the first click and the coordinates at the second click are not necessarily the same when the double-click operation is executed due to various factors. However, in this step 1004, the down coordinate and the up coordinate of the second click are corrected to the first down coordinate. That is, the coordinates of the second click are corrected to exactly the same positions as the coordinates where the first click occurred. By giving this corrected mouse event to the operation system (OS) of the computer, the operation system can be surely recognized that the double-click event has occurred. In step 1004, events other than the down event and the up event are discarded.

  Thereafter, the execution function control unit 802 initializes the number of clicks (step 1005). Subsequently, the execution function control unit 802 ends the storage of events (step 1006).

  Note that the function of correcting the coordinates of the second click event to the coordinate values of the first click event in this way can also be applied to triple clicks or more clicks. That is, it is possible to apply a function of correcting the coordinates of the third and subsequent click events to the coordinate values of the first click event. Thereby, the multi-click operation input through the operation input surface of the electronic board system can be recognized without error by the operation system.

  When a negative result is obtained in step 1003, the execution function control unit 802 determines that the event currently being processed is the first click (step 1010). Of course, also when it is determined in step 1002 that the number of clicks is the initial value, the execution function control unit 802 determines that the event currently being processed is the first click.

  In this case, the execution function control unit 802 generates a mouse event based on a down event included in the stored event. At this time, the execution function control unit 802 discards the storage event other than the down event.

  Next, the execution function control unit 802 generates a mouse event corresponding to the up event using the same coordinate value as that of the mouse event corresponding to the down event generated in Step 1010 (Step 1011). By executing this coordinate correction function, the operation system can be surely recognized that a single click event has occurred.

  Subsequently, in step 1012, the execution function control unit 802 sets 1 to the number of clicks. With this setting, it is possible to determine whether the first click or the second click when a second click is detected.

  Thereafter, the execution function control unit 802 stores the current time and coordinate value in the input information storage unit 803 as a click position (step 1013). The time and coordinate values stored in step 1013 are used in the determination process in step 1003, and are used for the correction of coordinates in step 1004.

  In the next step 1014, the execution function control unit 802 ends the subsequent event storage. As a result, the execution function control unit 802 releases the event storage until the next down event is detected.

  If it is determined in step 1001 that the event is not being stored, the execution function control unit 802 determines that the current up process is an event that does not relate to a click or a double click (step 1015). That is, the execution function control unit 802 determines that the event is an up event that has occurred in the process of generating a mouse event in real time. For this reason, the execution function control unit 802 converts the up event into a mouse event in real time.

  In this embodiment, every time a down event occurs, it is determined whether or not it is a click. However, in this method, an operation input such as a cloud point when drawing a character string may be recognized as a double click. There is sex. Therefore, in order to make it possible to distinguish between a cloud point and a double click, a function for determining whether or not a click operation is performed only for the first down event and the second down event after an event does not occur for a certain period of time is applied. You may do it.

(Other examples of up processing)
The processing method shown in FIG. 10 was assumed to be applied to a multi-click operation of triple click or more, but when the output to an operation system in which the multi-click operation of triple click or more has no special meaning is assumed. Instead of step 1004, the process shown in FIG. 11 may be executed.

  FIG. 11 is a flowchart showing a double click correction process for an operation system in which the triple click operation has no special meaning. It is assumed that the processing shown in FIG. 10 is executed except for step 1004 which is a replacement target.

  The process shown in FIG. 11 is executed when an up event for the second click is detected in step 1003 (FIG. 10). In this case, the execution function control unit 802 converts the event stored in the input information storage unit 803 into a mouse event as it is (step 1101). That is, the event stored for the second click (the event stored from the down event to the up event) is output as it is as a mouse event.

  Thereafter, the execution function control unit 802 converts the event into a mouse up event at the position of the up event currently being processed (step 1102).

  Then, using the coordinate value of the second up event as a reference point, the execution function control unit 802 automatically generates a mouse event corresponding to the down event at the same coordinates as in step 1102 (step 1103). Further, the execution function control unit 802 generates a mouse event corresponding to the up event at the same coordinates as in step 1102 (step 1104).

  The processing of step 1103 and step 1104 means that one click operation (virtual click) is automatically added to the double click operation actually performed by the operator. Of course, an appropriate time difference is added to the second click so that the operation system can distinguish the double click from the second click together with the second click. This is expected to improve identification accuracy as a double click in the operation system.

  Further, the method of generating double-click event information using the second click coordinates as in this embodiment has the following advantages. In general, the coordinate value during the down operation is likely to be shifted from the target point intended by the operator. However, it is easy to move the electronic pen in the down state to the correct position by the second up operation. Therefore, by using the coordinate value of the second up event, it is possible to reliably generate the event information of the double click for the operation area meaningful for the double click. In addition, this method does not change the coordinates of the event generated by the user even when the drawing of a cloud point when drawing a character string is erroneously determined to be a double click. For this reason, the situation where a muddy point is not drawn can be avoided. Moreover, even when the drawn writing result is processed by the character recognition program, a reduction in the recognition rate can be suppressed.

(Other examples)
In the above-described embodiment, the description has been made on the assumption that the coordinate input device is exclusively used in the electronic board system. However, the present invention is intended to process information related to operation input detected using a coordinate input device, and does not depend on the coordinate input method. Therefore, the present invention can be applied to a function for assisting click input to a device (for example, a capacitive touch panel) that can detect the coordinates of an input object with respect to the operation input surface. Therefore, the coordinate input device according to the embodiment includes a touch panel. In this case, the operation input surface of the coordinate input device matches the surface of the touch panel.

  In addition, the coordinate input device according to the present invention is only required to detect at least an operation input to the operation screen, and may be an independent device, or may be a device integrated with a display device (for example, a flat panel display). The coordinate input device according to the invention can also be applied to tablets and portable terminals.

  In addition, the detected coordinate conversion device according to the invention may be mounted inside the coordinate input device, or may be mounted on a device integrated with the coordinate input device. In addition, the erroneous input prevention device according to the invention may be mounted on various other devices that operate in cooperation with the coordinate input device.

DESCRIPTION OF SYMBOLS 101 Projection surface 102 Coordinate input device 103 Electronic pen 104 Operation screen projection device 105 Control computer 1051 Detection coordinate conversion program 106 Keyboard 107 Display device 108 Input area

Claims (6)

In a coordinate input device capable of detecting an operation input for a displayed or projected operation screen,
Processing means for storing detected events in a storage area;
If the down operation event has continued for a certain period of time from the start of the detection before the detection of the up operation event, the event stored in the storage area is converted into a mouse event as it is and the event storage ends. A processing means for converting an event input thereafter to a mouse event in real time ;
If the event of the down operation has continued for a certain distance from the start of the detection before the event of the up operation is detected, the event stored in the storage area is converted into a mouse event as it is and the event storage is terminated. A processing means for converting an event input thereafter to a mouse event in real time ;
A processing means for determining whether an event of an up operation is detected without detecting any of the above conditions after detecting the event of a down operation ;
If it is determined that the first click operation event upon detection of up operation event, generating a mouse event having detected the beginning of an event only up coordinates the same coordinate as the down coordinates detected immediately before the down operation And processing means for discarding events stored between the detection time of the down operation and the detection time of the up operation,
A coordinate input device comprising: processing means for recording the detected click position and detection time in the storage area. The coordinate input device according to claim 1,
If it is determined that the second click operation is detected when the up operation event is detected, a mouse event having the down coordinate and the up coordinate of the second click operation is generated at the first click position, and the up operation is detected from the time when the down operation is detected. A coordinate input device further comprising processing means for discarding events stored up to the point of time when the operation is detected. The coordinate input device according to claim 1,
Processing means for converting an event stored between the detection of the second down operation and the detection of the up operation into a mouse event as it is when it is determined that the second click operation is detected at the time of detecting the event of the up operation ;
Processing means for automatically generating two mouse events each having a down coordinate and an up coordinate at the same coordinates as the coordinates of the mouse event generated for the up operation of the second click operation. Coordinate input device. From a coordinate input device that can detect an operation input to the displayed or projected operation screen to a computer that inputs information related to the operation input of the input object to the displayed or projected operation screen,
Processing to store the detected event in the storage area;
If the event of the down operation has continued for a certain time from the start of the detection before detecting the event of the up operation, the event stored in the storage area is converted into a mouse event as it is, and the event storage is terminated. is allowed, the process of Ru is convert it after the input event to a mouse event in real time,
If the event of the down operation has continued for a certain distance from the start of the detection before detecting the event of the up operation, the event stored in the storage area is converted into a mouse event as it is, and the event storage is ended. is allowed, the process of Ru is convert it after the input event to a mouse event in real time,
After detecting a down operation event, if an up operation event is detected without satisfying any of the above conditions, a process for determining whether the event is a first click operation ;
If it is determined that the first click operation event upon detection of up operation event, generating a mouse event having detected the beginning of an event only up coordinates the same coordinate as the down coordinates detected immediately before the down operation And a process of discarding events stored between the detection time of the down operation and the detection time of the up operation,
A program for executing a process of recording the detected click position and detection time in the storage area. The program according to claim 4, wherein
If it is determined that the second click operation is detected when the up operation event is detected, a mouse event having the down coordinate and the up coordinate of the second click operation is generated at the first click position, and the up operation is detected from the time when the down operation is detected. A program further comprising a process of discarding an event stored until the time of detecting an operation. The program according to claim 4, wherein
When it is determined that the second click operation is detected when the up operation event is detected, a process of converting the event stored between the detection of the second down operation and the detection of the up operation into a mouse event as it is,
And a program for automatically generating two mouse events each having a down coordinate and an up coordinate at the same coordinates as the mouse event generated for the second click operation. .

Images