JP2010049469A - Coordinate processing apparatus and method, coordinate processing program, and computer readable recording medium with the coordinate processing program recorded thereon - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To correctly perform continuous operation such as dragging operation and rotational operation by reducing error detections and detection omissions when an instruction input not intended by a user is performed or even when an instruction input intended by the user is not detected. <P>SOLUTION: A coordinate processing apparatus 100 includes: a tracing part 11 for arranging coordinate points expressed by the coordinates of instruction positions to be moved by user's instruction input operation on frames continued in time series and tracing correspondence of coordinate points between respective frames; and a determination part 13 for determining a state transition among a plurality of states including a first state to be an instruction input start waiting state, a second state to be a moving state of an instruction position to be moved by the instruction input and a third state to be an instruction input end waiting state, which are previously defined as user's instruction input states, based on the traced results of the tracing part 11 and determining user's instruction input operation to be executed when the determined state transition is performed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a coordinate processing apparatus and method suitable for coordinate position detection processing on a touch panel, a touch screen, a tablet, and the like, a coordinate processing program, and a computer-readable recording medium on which the coordinate processing program is recorded.

  In recent years, portable devices having intuitive operability equipped with a display panel (for example, a touch panel, a touch screen, and a tablet) capable of touch input at a plurality of points have been developed as products, and can be touch input in the future. The need for display panels is expected to expand.

  In a display panel capable of touch input of multiple points, when obtaining trajectory information of temporally continuous points, a plurality of points touched in the previous frame and a plurality of points touched in the current frame Need to be associated.

  For example, Patent Document 1 discloses a method of interpreting a drag operation, a rotation operation, an enlargement / reduction operation, and the like based on trajectory information of points that are continuous in time in an operation on a touch panel.

  Specifically, Patent Document 1 discloses a technique for determining the point closest to the previous designated position as the current position when determining which point the current point corresponds to, and a plurality of locations. A technique for determining a point having the closest area among the indicated positions as the current position is disclosed.

That is, Patent Document 1 discloses a technique that can interpret an instruction expressed by a combination of trajectories in which a plurality of instruction positions move simultaneously.
JP 2001-290585 A (published on October 19, 2001)

  However, in the method described in Patent Document 1, in the case of erroneous detection or detection omission due to noise or the like of a device equipped with a touch panel, or in the case of erroneous detection because the user has unintentionally touched, When the touching force on the touch panel is weak and detection is omitted, there is a problem that a point different from the original touch intention by the user is used as a touch point. Further, there is a problem that the tracking point due to the continuation of the touch is retouched after the touch is finished (released).

  For this reason, with the method described in Patent Document 1, it is difficult to correctly operate continuous operations such as a drag operation, a rotation operation, and an enlargement / reduction operation.

  In view of the above problems, the object of the present invention is to detect noise when the touch detection is performed due to the noise of the device or the user unintentionally touching the touch panel, or when the touch on the touch panel is weak and detection omission is detected. Coordinate processing device and method for reducing unintentional false detections and omissions even when they occur and correctly operating continuous operations such as drag operations, rotation operations, and enlargement operations, and coordinate processing programs and coordinate processing programs thereof are recorded An object of the present invention is to provide a computer-readable recording medium.

  In order to achieve the above object, the coordinate processing apparatus according to the present invention arranges coordinate points represented by the coordinates of the designated position to be moved by the user's designated input on a continuous frame in time series, and coordinates points between the frames. A tracking unit that tracks the correspondence between the user, a first state that is a standby state for starting the instruction input, and a movement state of an instruction position that is moved by the instruction input. A state transition between a plurality of states including a second state and a third state that is a waiting state for completion of the instruction input is determined based on a tracking result by the tracking unit, and the determined state transition Determination means for determining an operation of the user's instruction input that is executed when the operation is performed.

  In the coordinate processing apparatus, the tracking unit arranges the coordinate points represented by the coordinates of the designated position that is moved by the operation of the user's instruction input on a frame that is continuous in time series, and the correspondence relationship between the coordinate points between the frames. To track. As a state of the user's instruction input, a first state that is a start standby state of the instruction input, a second state that is a movement state of an instruction position that is moved by the instruction input, and a standby state that is the end of the instruction input A plurality of states including three states are defined in advance, and the determination unit determines a state transition between these states based on a tracking result by the tracking unit. Then, the determination means determines the operation of the user's instruction input that is executed when the determined state transition is performed.

  In other words, since the tracking means tracks the association of coordinate points between frames, even if an erroneous instruction input not intended by the user is temporarily detected, it is assumed that there was no erroneous instruction input. be able to. Therefore, the determination means can determine the state transition of the user's instruction input without being affected by an erroneous instruction input, and can accurately determine the operation of the user's instruction input.

  Conversely, even if the instruction input intended by the user is not temporarily detected, the instruction input can be treated as being present. Therefore, it is possible to determine the state transition of the user's instruction input without being affected by the instruction input that has not been detected, and it is possible to accurately determine the operation of the user's instruction input.

  The tracking means preferably associates the coordinate points arranged in each of the different frames when the distance between the coordinate points arranged in different frames is equal to or less than a predetermined distance.

  In this case, since the coordinate points can be associated with each other by comparing the magnitude relationship between the distance between the two coordinate points and a predetermined distance, the coordinate points can be efficiently associated with each other.

  The operation of the user's instruction input to be determined by the determination means includes a first operation indicating the start confirmation of the instruction input, a second operation indicating continuation of movement of the instruction position, and the end of the instruction input. Preferably, a third action representing confirmation is included.

  In this case, an appropriate operation according to the state transition of the user's instruction input can be determined.

  When the determination means determines that the state transition from the first state to the second state, it is preferable to determine the first operation.

  In this case, an appropriate operation can be determined when the state of the user's instruction input transitions from the first state to the second state.

  The determination means has a number of frames in which the coordinate points are arranged by the tracking means equal to or more than a predetermined first frame number, and coordinates having other coordinate points associated with each other in the frames. It is preferable to determine that the transition from the first state to the second state occurs when the number of frames in which the points are arranged is equal to or greater than a predetermined second frame number.

  In this case, it is possible to more accurately determine the state transition in which the state of the user's instruction input transitions from the first state to the second state.

  When the determination means determines that the state transition is from the second state to the second state, or when it is determined that the state transition is from the third state to the second state, the second operation Is preferably determined.

  In this case, it is possible to determine an appropriate operation when the state of the user's instruction input transitions from the second state to the second state or when the user transitions from the third state to the second state. it can.

  In the second state, when the coordinate points arranged in each of successive frames are associated with each other in the second state, the determination unit determines to transition from the second state to the second state. preferable.

  In this case, it is possible to more accurately determine the state transition in which the state of the user's instruction input transitions from the second state to the second state.

  In the third state, the determination unit determines in advance the number of frames in which coordinate points that do not have other coordinate points associated with each other are arranged among the frames in which coordinate points are arranged by the tracking unit. Preferably, the third operation is determined when the number of frames exceeds the third frame number.

  In this case, it is possible to appropriately determine the third operation when the user's instruction input state is the third state.

  According to the coordinate processing method of the present invention, a tracking step is performed in which coordinate points represented by coordinates of an instruction position that is moved by an instruction input by a user are arranged on a continuous frame in time series, and the association of the coordinate points between the frames is tracked. And a first state that is predefined as a state of instruction input of the user, a second state that is a movement state of an instruction position that is moved by the instruction input, It is executed when a state transition between a plurality of states including the third state, which is the end waiting state of the instruction input, is determined based on a tracking result by the tracking step and the determined state transition is performed. A determination step of determining an operation of the user's instruction input.

  In the coordinate processing method described above, in the tracking step, the coordinate points represented by the coordinates of the designated position that is moved by the operation of the user's instruction input are arranged on a continuous frame in time series, and the correspondence relationship between the coordinate points between the frames. To track. As a state of the user's instruction input, a first state that is a start standby state of the instruction input, a second state that is a movement state of an instruction position that is moved by the instruction input, and a standby state that is the end of the instruction input A plurality of states including three states are defined in advance, and in the determination step, the state transition between these states is determined based on the tracking result by the tracking means. Then, the user instruction input operation to be executed when the determined state transition is performed is determined.

  In other words, since the association of coordinate points between frames is tracked, even if an erroneous instruction input not intended by the user is temporarily detected, it can be handled that there is no erroneous instruction input. . Therefore, it is possible to determine the state transition of the user's instruction input without being affected by an erroneous instruction input, and to accurately determine the operation of the user's instruction input.

  Conversely, even if the instruction input intended by the user is not temporarily detected, the instruction input can be treated as being present. Therefore, it is possible to determine the state transition of the user's instruction input without being affected by the instruction input that has not been detected, and it is possible to accurately determine the operation of the user's instruction input.

  The information recording / reproducing apparatus may be realized by a computer. In this case, a control program for the information recording / reproducing apparatus for realizing the information recording / reproducing apparatus by the computer by operating the computer as the respective means. And a computer-readable recording medium on which it is recorded also fall within the scope of the present invention.

  As described above, the coordinate processing apparatus of the present invention arranges the coordinate points represented by the coordinates of the designated position to be moved by the user's designated input on the frames that are continuous in time series, and associates the coordinate points between the frames. Tracking means for tracking the first input state, a first state in which the instruction input is waiting to be started, and a movement state of the instruction position that is moved by the instruction input. And a state transition between a plurality of states including the third state which is a waiting state for completion of the instruction input based on the tracking result by the tracking unit, and the determined state transition is performed. Determination means for determining an instruction input operation of the user that is sometimes executed.

  Therefore, unintentional false detection even when touch detection is performed due to device noise, etc., or when the user touches the touch panel unintentionally, or even when the touch panel is weak and a detection failure occurs. And coordinate processing apparatus and method for correctly operating continuous operations such as drag operation, rotation operation, and enlargement operation, and a coordinate processing program and a computer-readable recording medium recording the coordinate processing program The effect of doing.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings used for the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

(Embodiment 1)
The coordinate processing apparatus according to Embodiment 1 of the present invention is connected to a touch panel on which a user can input a position with a finger or the like, for example, and the coordinates of the user's designated position are obtained based on a signal output from the touch panel. It detects and realizes continuous operations such as a drag operation, a rotation operation, and an enlargement / reduction operation by moving the user's designated position on the touch panel. FIG. 1 is a block diagram showing the configuration of the coordinate processing apparatus according to Embodiment 1 of the present invention.

  As shown in FIG. 1, the coordinate processing apparatus 100 according to Embodiment 1 of the present invention includes a detection unit 10, a tracking unit (tracking unit) 11, a coordinate information storage unit 12, a determination unit (determination unit) 13, and , Generating unit 14, setting unit 15, first threshold storage unit 16, and second threshold storage unit 17.

  The detection unit 10 is connected to a touch panel 500 that allows a user to input a position. When the signal output from the touch panel 500 is input to the detection unit 10, the detection unit 10 determines that the position input by the user is on the touch panel 500, and the user on the touch panel 500 based on the output signal. The coordinates of the indicated position by are detected. Then, the detection unit 10 outputs the coordinates of the position indicated by the user to the tracking unit 11.

  The coordinate detection by the detection unit 10 is executed at a constant cycle (for example, 30 Hz). Therefore, when the output signal of touch panel 500 is not input at the timing of detecting the coordinates, detection unit 10 determines that there is no position input by the user on touch panel 500. In this case, the detection unit 10 does not output the coordinates of the position indicated by the user at that timing. Note that the touch panel 500 can be appropriately selected from a touch panel using a known method such as a resistive film method, a capacitance method, an ultrasonic surface acoustic wave method, or the like.

  When the coordinates of the designated position by the user are input from the detection unit 10, the tracking unit 11 generates frame information at the input time point based on the input coordinates. When a plurality of coordinates are input from the detection unit 10, the tracking unit 11 generates frame information in which a plurality of coordinates are arranged on the same frame at the time of input.

  FIG. 2 is a diagram for explaining the frame information generated by the tracking unit 11. As shown in FIG. 2, the tracking unit 11 arranges the coordinates output from the detection unit 10 at a constant period on the frames 21 to 24 and generates frame information of the frames 21 to 24. The tracking unit 11 outputs the frame information to a coordinate information storage unit 12 described later.

  Further, when the coordinates of the position indicated by the user are input from the detection unit 10, the tracking unit 11 generates tracking point information based on the input coordinates and the past frame information from the input time point. This tracking point information is generated for each point (hereinafter also referred to as “tracking point”) corresponding to the same instruction input by the user between the frames. Of course, when the user moves the designated position between different frames, the tracking point corresponding to the designated position has different coordinates in each frame. This tracking point information is generated for each tracking point.

  The coordinate information storage unit 12 stores frame information 121 and tracking point information 122 output from the tracking unit 11. The coordinate information storage unit 12 can be appropriately selected from a known storage device such as a magnetic disk device such as a hard disk drive (hereinafter referred to as “HDD”) or a semiconductor memory.

  FIG. 3 is a diagram for explaining the tracking point information 122 stored in the coordinate information storage unit 12. As shown in FIG. 3, the tracking point information 122 includes a current state 31, a tracking frame number 32, a current frame coordinate 33, a past frame coordinate 34, an identifier 35, and a reservation event 36 for each tracking point. These will be described later.

  When the coordinates of the user's designated position are input from the detection unit 10 to the tracking unit 11, the determination unit 13 acquires the coordinates from the tracking unit 11. And the determination part 13 performs the state transition determination with respect to the coordinate point using the tracking point information 122 memorize | stored in the coordinate information storage part 12, and the tracking point corresponding to each coordinate point based on the determination result Information 122 is subjected to status update and event reservation (down event, move event, up event, no event, etc.). Of course, the determination unit 13 outputs a plurality of events at the same time.

  Here, the state transition automaton used for the state transition determination performed by the determination unit 13 will be described. FIG. 6 is a diagram illustrating an example of the state transition automaton.

  As shown in FIG. 6, the state transition automaton used for the state transition determination by the determination unit 13 includes three types of down monitoring (first state), move (second state), and up monitoring (third state). State, arrow indicating connection relation of each state transition, down event (first operation), move event (second operation) and up event (third operation) generated according to the transition contents between each state 3 events (operations). The coordinate processing apparatus 100 according to the present embodiment includes, for example, an operation of touching the touch panel 500 with one or more fingers (press), continuation of touch, movement on the panel while continuing touch, and termination of touch (release). The coordinates of the touch position obtained by the touch operation such as) are processed.

  Therefore, in the following, for the various operations described above, the touch operation (press) is a down event, the touch is continued, and the movement on the panel while continuing the touch is a move event, and the touch end (release) is an up event. Respectively. Therefore, the down event means the tracking point is confirmed, the move event means the tracking point is continued, and the up event means the tracking point disappearance is confirmed. In the present embodiment, when a series of coordinate tracking is performed from when the user starts one touch to the end of the touch until the user releases the finger from the touch panel 500, the down event is performed only once at the start of the touch. The case where the move event is executed for every frame and the up event is executed only once at the end of the touch will be described.

  The generation unit 14 extracts tracking points corresponding to the tracking point information 122 reserved for the event from the tracking point information 122 stored in the coordinate information storage unit 12. Based on the extraction result, the generation unit 14 generates and outputs the coordinates of the tracking points for each event type, for example.

  The setting unit 15 has, for example, a numeric keypad, a keyboard, etc., and initializes and sets the first threshold value stored in the first threshold value storage unit 16 and the second threshold value stored in the second threshold value storage unit 17. This is for initializing and setting. The user uses the setting unit 15 to initialize and set the first threshold value stored in the first threshold value storage unit 16 and the initial value of the second threshold value stored in the second threshold value storage unit 17. Can be configured and set.

  When the tracking unit 11 generates tracking point information, the first threshold storage unit 16 is a point corresponding to the same instruction input as the newly input coordinate point among the tracking points arranged in the past frame. The first threshold value used for determining whether or not there is is stored.

  The first threshold is, for example, a distance from a new input coordinate point. If there is a distance from the new input coordinate point to the tracking point closest to the distance, the tracking unit 11 may The tracking point and the input coordinate point are determined to correspond to the same instruction input. On the other hand, if the distance from the new input coordinate point to the closest tracking point exceeds the first threshold, the tracking unit 11 has no tracking point corresponding to the same instruction input as the input coordinate. judge.

  The second threshold storage unit 17 stores a second threshold used for the determination unit 13 to make a state transition determination for the input coordinate point. When new coordinates are input from the tracking unit 11, the determination unit 13 acquires the second threshold value stored in the second threshold value storage unit 17, and is stored in the second threshold value and coordinate information storage unit 12. Using the tracking point information 122, the state transition determination for the coordinate point is performed. A specific example of the second threshold will be described later.

  Next, the operation of the coordinate processing apparatus 100 according to Embodiment 1 of the present invention will be described with reference to FIG. FIG. 4 is a flowchart for explaining the operation of the coordinate processing apparatus 100 according to Embodiment 1 of the present invention.

  As shown in FIG. 4, when a new coordinate is input from the detection unit 10, the tracking unit 11 acquires frame information 121 stored in the coordinate information storage unit 12, and tracks the tracking point near the input coordinate point. It is determined whether or not there is (step S101).

  Specifically, when a new coordinate is input from the detection unit 10, the tracking unit 11 reads the latest frame from the frame information 121 stored in the coordinate information storage unit 12, The distance between each tracking point and the coordinate point input from the detection unit 10 is compared to determine the presence or absence of a nearby tracking point.

  The tracking unit 11 acquires the first threshold value stored in the first threshold value storage unit 16. The first threshold value is stored in advance in the first threshold value storage unit 16 by the user using the setting unit 15. The user can change the determination accuracy of the presence / absence of the tracking point by the tracking unit 11 by adjusting the first threshold value.

  For example, if the first threshold represents a predetermined distance, the tracking unit 11 determines that there is a nearby tracking point when the closest tracking point is within the first threshold (YES in step S101).

  On the other hand, if the distance between the input coordinate point and the closest tracking point is greater than the first threshold, the tracking unit 11 determines that there is no nearby tracking point (NO in step S101).

  Here, in the above step S101 YES, the tracking unit 11 determines that there is a nearby tracking point, and the tracking point that the input coordinate point follows the nearby tracking point, that is, the point corresponding to the same instruction input by the user. It is determined that Then, the tracking unit 11 adds one tracking frame number 32 of the tracking point information 122 corresponding to the tracking point, and sets the input coordinate as the current frame coordinate 33.

  On the other hand, in the above step S101 NO, the tracking unit 11 determines that there is no neighboring tracking point, sets the input coordinate point as a new additional point, and generates the tracking point information 122 (step S102). At this time, the tracking unit 11 sets the new tracking point information 122 as initial information as “down monitoring” in the current state 31, “1” in the number of tracking frames 32, and the input coordinates in the current frame coordinates 33. Set. Note that nothing is set in the past frame coordinates 34 here.

  The determination unit 13 performs the first state transition determination on the tracking point determined to be followed by the input coordinates in step S101 YES and the tracking point newly set in step S102 (step S103). The processing content of the first state transition determination in step S103 will be described later.

  The tracking unit 11 and the determination unit 13 repeatedly execute the above steps S101 to 103 until the above steps S101 to 103 are executed for all the coordinate points newly input from the detection unit 10 (YES in step S104). (Step S104 NO).

  The determination unit 13 determines the presence / absence of a tracking point whose state transition determination is undetermined from the tracking point information 122 stored in the coordinate information storage unit 12 (step S105), and if there is an undetermined tracking point (step S105). (S105 YES), the second state transition determination is executed for the tracking point (step S106). The processing content of the second state transition determination in step S106 will be described later. The processing content of the first state transition determination in step S103 and the processing content of the second state transition determination in step S106 are the same.

  In this step S106, the determination unit 13 adds “1” to the number of tracking frames 32 of the tracking point information 122 corresponding to the tracking point before starting the state transition determination process of the undetermined tracking point, The current frame coordinate 33 is set to an unset state.

  The generation unit 14 determines the presence / absence of a reserved event from the tracking point information 122 stored in the coordinate information storage unit 12 (step S107), and if no event is reserved for any tracking point (NO in step S107), The process ends.

  On the other hand, when there is an event reservation, the generation unit 14 extracts the tracking point identifier 35, the reservation event 36, and the current frame coordinates 33 from the tracking point information 122 corresponding to the tracking point with the event reservation. . And the production | generation part 14 produces | generates and outputs the identifier and coordinate of the tracking point corresponding to each event, for example for every event using the extraction result (step S108).

  Specifically, for example, as a result of processing for a certain frame, one point (Xd1, Yd1) at which a new touch is confirmed (down event) is determined as a tracking point being tracked (move event). When the number of points is two (Xm1, Ym1) and (Xm2, Ym2), the generation unit 14 generates a down event and coordinates (Xd1, Yd1) as coordinates associated with the down event. And an identifier (for example, “tracking point C”) are output. In addition, a move event is generated, and coordinates (Xm1, Ym1) and an identifier (for example, “tracking point A”), and coordinates (Xm2, Ym2) and an identifier (for example, “ The tracking point B ") is output.

  In the above-described specific example, as a result of performing a process on a certain frame, one or a plurality of coordinates corresponding to each event are assumed on the assumption that only one event of the same kind is output at most. Although the case where an identifier is output in association with an event has been described, a plurality of events of the same type may be output, and one associated coordinate and identifier may be output for each event. Also good.

  Next, the processing contents of the first and second state transition determinations in steps S103 and S106 of FIG. 4 will be described. FIG. 5 is a flowchart showing the processing contents of the first and second state transition determinations in steps S103 and S106.

  Note that the determination unit 13 executes the first state transition determination for the newly set tracking point in the above step S103, and performs the second state transition determination for the undetermined tracking point in the above step S106. Execute. The first state transition determination and the second state transition determination are the same in the processing content itself, except that the tracking points to be determined are different. For this reason, below, the 1st state transition determination in said step S103 is demonstrated.

  As shown in FIG. 5, when a new coordinate is input from the tracking unit 11, the determination unit 13 acquires tracking point information 122 corresponding to the coordinate point from the coordinate information storage unit 12, and the current coordinate point is obtained. The state 31 is detected (step S201). If it is in the down monitoring state, the determination unit 13 proceeds to step S202. If it is in the move state, the process proceeds to step S207. If it is in the up monitoring state, the process proceeds to step S210.

  First, in the above step S201, when it is determined that the state is the down monitoring state, the determination unit 13 determines the threshold frame number Md, which is one of the second threshold values stored in the second threshold value storage unit 17, as follows. It is acquired and it is determined whether or not the tracking frame number 32 of the tracking point information 122 of the coordinate point has reached the threshold frame number Md (whether or not it has passed) (S202).

  Here, the threshold frame number Md means how many frames are accumulated from when down is confirmed, that is, until the state transition from down monitoring to move, that is, the number of frames required to determine down. . Therefore, for example, the smaller the threshold frame number Md, the faster the down determination in step S202 described above, and the larger the threshold frame number Md, the slower the down determination in step S202 described above. Moreover, the accuracy of down determination is improved as the threshold frame number Md and the threshold frame number Nd described later are larger. For this reason, the user can change the precision of the down determination in said step S202 by the determination part 13 by adjusting this threshold frame number Md using the setting part 15. FIG.

  When the threshold frame number Md has not been reached (NO in step S202), the determination unit 13 shifts each of the past frame coordinates 34 as one more past frame coordinate with respect to the tracking point information 122 corresponding to the coordinate point. At the same time, the current frame coordinates are set as the latest past frame coordinates. Further, the determination unit 13 sets the current frame coordinates 33 to an unset state. That is, the determination unit 13 updates the coordinates of the current frame coordinates 33 and the past frame coordinates 34 so as to be shifted by one frame in the past. At this time, among the coordinates corresponding to each frame, the coordinates of the frame in which the neighboring coordinates are not detected, that is, the frame coordinates in the unset state are also shifted and updated as they are. In this way, the state transition determination by the determination unit 13 returns (ends).

  On the other hand, when it is determined that the threshold frame number Md has been reached (YES in step S202), the determination unit 13 determines the threshold frame number Nd as another one of the second threshold values stored in the second threshold value storage unit 17. It is determined whether the number of set states is equal to or greater than the threshold frame number Nd among the current frame coordinates 33 and the past frame coordinates 34 of the tracking point information 122 corresponding to the coordinates (S203).

  Here, the threshold frame number Nd means the number of frames required to determine the position input by the user (here, the touch by the user). Therefore, for example, the smaller the threshold frame number Nd, the easier it is to determine that the touch is made in step S203, and the larger the threshold frame number Nd is, the more difficult it is to determine that the touch is made in step S203. That is, the larger the threshold frame number Nd and the above-described threshold frame number Md, the more accurate the down determination. For this reason, the user can change the accuracy of the touch determination in step S <b> 203 by the determination unit 13 by adjusting the threshold frame number Nd using the setting unit 15.

  When it is determined that the threshold frame number is Nd or more (step S203 YES), the determination unit 13 sets a down event as the reservation event 36 of the tracking point information 122 corresponding to the coordinate point, and also sets the identifier 35. (Step S204).

  Then, the determination unit 13 updates the current state 31 of the tracking point information 122 corresponding to the coordinate point to “move state” (S205). Further, the determination unit 13 shifts each of the past frame coordinates 34 by one as the past frame coordinates with respect to the tracking point information 122 corresponding to the coordinate point, and the current frame coordinates are the latest past frame coordinates. Set as. Further, the determination unit 13 sets the coordinates input from the tracking unit 11 as the current frame coordinates 33. That is, the determination unit 13 updates the coordinates of the current frame coordinates 33 and the past frame coordinates 34 so as to be shifted by one frame in the past. At this time, among the coordinates corresponding to each frame, the coordinates of the frame in which the neighboring coordinates are not detected, that is, the frame coordinates in the unset state are also shifted and updated as they are. In this way, the state transition determination by the determination unit 13 returns (ends).

  On the other hand, when it is determined that the number is less than the threshold frame number Nd (NO in step S203), the determination unit 13 discards the coordinate point from the tracking point information 122 corresponding to the coordinate point (S206). That is, since the number of tracking frames does not reach the threshold frame number Nd, the coordinate point is generated by erroneous detection and is excluded as being contrary to the user's intention. Then, the determination unit 13 returns (ends) the state transition determination in the same manner as described above.

  Next, if it is determined in step S201 that the moving state is set, the determination unit 13 determines whether there is a current frame coordinate 33 of the tracking point information 122 corresponding to the new coordinate input from the tracking unit 11. That is, it is determined whether or not the current frame coordinates 33 are set (step S207).

  When it is determined that the current frame coordinate 33 is present (YES in step S207), the determination unit 13 sets a move event as the reservation event 36 of the tracking point information 122 corresponding to the coordinate point and sets the identifier 35. Further, the determination unit 13 sets the newly input coordinates as the current frame coordinates 33 (step S208). Further, the determination unit 13 sets the current frame coordinate 33 set previously with respect to the tracking point information 122 as the latest past frame coordinate 34. That is, each frame coordinate is updated so as to be shifted by one frame in the past.

  On the other hand, when it is determined that there is no current frame coordinate 33 (NO in step S207), the determination unit 13 updates the current state 31 of the tracking point information 122 corresponding to the coordinate point to the “up monitoring state” (S209). . Further, the past frame coordinates 34 are shifted one by one as the past frame coordinates, and the latest past frame coordinates 34 and the current frame coordinates 33 are set in an unset state. That is, each frame coordinate is updated so as to be shifted by one frame in the past. At this time, among the coordinates corresponding to each frame, the coordinates of the frame in which the neighboring coordinates are not detected, that is, the frame coordinates in the unset state are also shifted and updated as they are. In this way, the state transition determination by the determination unit 13 returns (ends).

  Finally, in the above-described step S201, when it is determined that the up monitoring state is present, the determination unit 13 determines whether there is a current frame coordinate 33 of the tracking point information 122 corresponding to the new coordinate input from the tracking unit 11. It is determined whether or not, that is, whether or not the current frame coordinates 33 are set (step S210).

  When it is determined that there is no current frame coordinate 33 (step S210 YES), the determination unit 13 acquires a threshold frame number Nu that is yet another one of the second threshold values stored in the second threshold value storage unit 17. Then, it is determined whether or not the number of unset states among the current frame coordinates 33 and the past frame coordinates 34 of the tracking point information 122 corresponding to the coordinates is equal to or greater than the threshold frame number Nu (S211).

  Here, the threshold frame number Nu means the number of frames required to determine the end of the position input by the user (here, up by the user). Therefore, for example, the smaller the threshold frame number Nu, the faster the up determination in step S211 described above. The larger the threshold frame number Nu, the longer the tracking point is detected in the vicinity of the input coordinate point for a sufficient period. It is confirmed that there is not, and the determination accuracy is improved, but the up determination in step S211 is delayed. For this reason, the user can change the accuracy of the up determination in step S211 by the determination unit 13 by adjusting the threshold frame number Nu using the setting unit 15.

  When it is less than the threshold frame number Nu (step S211 NO), the determination unit 13 shifts the past frame coordinates 34 of the tracking point information 122 corresponding to the coordinate point one by one as the past frame coordinates, and the latest past The frame coordinates 34 and the current frame coordinates 33 are set in an unset state. That is, each frame coordinate is updated so as to be shifted by one frame in the past. At this time, among the coordinates corresponding to each frame, the coordinates of the frame in which the neighboring coordinates are not detected, that is, the frame coordinates in the unset state are also shifted and updated as they are. In this way, the state transition determination by the determination unit 13 returns (ends).

  On the other hand, if it is determined that the threshold frame number Nu is greater than or equal to Nu (YES in step S211), the determination unit 13 sets an up event as the reservation event 36 of the tracking point information 122 corresponding to the coordinate point, and also includes the identifier 35. It sets (step S212). Then, the determination unit 13 discards the coordinate point from the tracking point information 122 corresponding to the coordinate point (S213). That is, when the threshold frame number Nu is reached, the coordinate point is not temporarily lost due to omission of detection but is excluded as being released (up) by the user's intention. Thereafter, the determination unit 13 returns (ends) the state transition determination in the same manner as described above.

  When it is determined that there is the current frame coordinate 33 (NO in step S210), the determination unit 13 sets a move event as the reservation event 36 of the tracking point information 122 corresponding to the coordinate, and also sets the identifier 35. (Step S214).

  The determination unit 13 updates the current state 31 of the tracking point information 122 to “move state”. Then, the determination unit 13 sets the current frame coordinates 33 of the tracking point information 122 as the latest past frame coordinates 34, and sets the current frame coordinates to an unset state. That is, the determination unit 13 updates the frame coordinate information so that it is shifted by one frame in the past.

  Next, a specific example of coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention will be described.

(Specific example 1)
FIG. 7 is a diagram for explaining an example of down determination by coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention. Here, it is assumed that the threshold frame number Md is 3 and the threshold frame number Nd is 2.

  In FIG. 7, a frame 41a, a frame 41b, and a frame 41c represent three frames that are temporally continuous, and the x mark and coordinates shown in each frame are detected by the detection unit 10 in each frame. Indicates the coordinates of the indicated position. In FIG. 7, the current state 31, tracking frame number 32, current frame coordinates 33, and past frame coordinates 34 of the tracking point information 122 stored in the coordinate information storage unit 12 correspond to the frames 41a to 41c. The state of changing with time is shown (42a to 42f).

  First, when the detection unit 10 detects the coordinates (50, 100) of the designated position of the frame 41a, if the tracking unit 11 determines in step S101 in FIG. 4 that there is no near tracking point, the tracking unit 11 in step S202 The tracking point information 122 stored in the coordinate information storage unit 12 is set in the tracking point information 42a shown in FIG.

  Next, in step S103 and step S202 of FIG. 5, the determination unit 13 determines that the tracking frame number 32 has not reached the threshold frame number Md (= 3), and the determination unit 13 stores the coordinate information in the coordinate information storage unit 12. The tracking point information 122 thus set is set in the tracking point information 42b shown in FIG.

  Next, when the detection unit 10 detects the coordinates (49, 101) of the designated position of the frame 41b, the tracking unit 11 determines that there is a nearby tracking point in step S101, and the tracking unit 11 stores the coordinates in the coordinate information storage unit 12. The stored tracking point information 122 is set in the tracking point information 42c shown in FIG.

  Next, in step S103 and step S202, the determination unit 13 determines that the tracking frame number 32 has not reached the threshold frame number Md (= 3), and the determination unit 13 is stored in the coordinate information storage unit 12. The tracking point information 122 is set in the tracking point information 42d shown in FIG.

  Next, when the detection unit 10 detects the coordinates (51, 102) of the designated position of the frame 41c, the tracking unit 11 determines that there is a nearby tracking point in step S101, and the tracking unit 11 stores the coordinates in the coordinate information storage unit 12. The stored tracking point information 122 is set in the tracking point information 42e shown in FIG.

  Next, in step S103, step S202, and step S203, the determination unit 13 determines that the tracking frame number 32 has reached the threshold frame number Md (= 3), and the current frame coordinates 33 of the tracking point information 42e and Of the past frame coordinates 34, it is determined that the number of setting states has reached the threshold frame number Nd (= 2), and the determination unit 13 shows the tracking point information 122 stored in the coordinate information storage unit 12 as shown in FIG. The tracking point information 42f is set.

(Specific example 2)
FIG. 8 is a diagram for explaining another example of the down determination by the coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention. Here, it is assumed that the threshold frame number Md is 3 and the threshold frame number Nd is 2.

  In FIG. 8, a frame 51a, a frame 51b, and a frame 51c represent three temporally continuous frames, and the x mark and coordinates shown in each frame are detected by the detection unit 10 in each frame. Indicates the coordinates of the indicated position. Also, the dotted x mark indicates the coordinates of the designated position detected in the past frame, and represents a state where no new designated position exists near the coordinates of the designated position in the current frame. Further, in FIG. 8, the current state 31, tracking frame number 32, current frame coordinates 33, and past frame coordinates 34 of the tracking point information 122 stored in the coordinate information storage unit 12 correspond to the frames 51a to 51c. The state of changing with time is shown (52a to 52f).

  First, when the detection unit 10 detects the coordinates (50, 100) of the designated position of the frame 51a, if the tracking unit 11 determines in step S101 in FIG. 4 that there is no nearby tracking point, the tracking unit 11 in step S202 The tracking point information 122 stored in the coordinate information storage unit 12 is set in the tracking point information 52a shown in FIG.

  Next, in step S103 and step S202 of FIG. 5, the determination unit 13 determines that the tracking frame number 32 has not reached the threshold frame number Md (= 3), and the determination unit 13 stores the coordinate information in the coordinate information storage unit 12. The tracking point information 122 that has been set is set in the tracking point information 52b shown in FIG.

  Next, when the detection unit 10 does not detect a new instruction input, the determination unit 13 determines that there is an undetermined tracking point in step S <b> 105 of FIG. 4, and the determination unit 13 stores it in the coordinate information storage unit 12. The tracking point information 122 that has been set is set in the tracking point information 52c shown in FIG.

  Next, in step S106, step S202, and step S203, the determination unit 13 determines that the tracking frame number 32 has not reached the threshold frame number Md (= 3), and the determination unit 13 stores the coordinate information in the coordinate information storage unit 12. The tracking point information 122 that has been set is set in the tracking point information 52d shown in FIG.

  Next, when the detection unit 10 detects the coordinates (51, 102) of the designated position of the frame 51c, the tracking unit 11 determines that there is a nearby tracking point in step S101, and the tracking unit 11 stores the coordinates in the coordinate information storage unit 12. The stored tracking point information 122 is set in the tracking point information 52e shown in FIG.

  Next, in step S103, step S202, and step S203, the determination unit 13 determines that the tracking frame number 32 has reached the threshold frame number Md (= 3), and the current frame coordinates 33 of the tracking point information 52e and Of the past frame coordinates 34, it is determined that the number of setting states has reached the threshold frame number Nd (= 2), and the determination unit 13 shows the tracking point information 122 stored in the coordinate information storage unit 12 as shown in FIG. The tracking point information 52f is set.

(Specific example 3)
FIG. 9 is a diagram for describing an example of avoiding erroneous detection by coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention. Here, it is assumed that the threshold frame number Md is 3 and the threshold frame number Nd is 2.

  In FIG. 9, a frame 61a, a frame 61b, and a frame 61c represent three temporally continuous frames, and the x mark and coordinates shown in each frame are detected by the detection unit 10 in each frame. Indicates the coordinates of the indicated position. Also, the dotted x mark indicates the coordinates of the designated position detected in the past frame, and represents a state where no new designated position exists near the coordinates of the designated position in the current frame. Further, in FIG. 9, the current state 31, tracking frame number 32, current frame coordinates 33, and past frame coordinates 34 of the tracking point information 122 stored in the coordinate information storage unit 12 correspond to the frames 61a to 61c. The state of changing with time is shown (62a to 62f).

  First, when the detection unit 10 detects the coordinates (50, 100) of the designated position of the frame 61a, if the tracking unit 11 determines in step S101 in FIG. 4 that there is no near tracking point, the tracking unit 11 in step S202 The tracking point information 122 stored in the coordinate information storage unit 12 is set in the tracking point information 62a shown in FIG.

  Next, in step S103 and step S202 of FIG. 5, the determination unit 13 determines that the tracking frame number 32 has not reached the threshold frame number Md (= 3), and the determination unit 13 stores the coordinate information in the coordinate information storage unit 12. The tracking point information 122 thus set is set in the tracking point information 62b shown in FIG.

  Next, when the detection unit 10 does not detect a new instruction input, the determination unit 13 determines that there is an undetermined tracking point in step S <b> 105 of FIG. 4, and the determination unit 13 stores it in the coordinate information storage unit 12. The tracking point information 122 thus set is set in the tracking point information 62c shown in FIG.

  Next, in step S106, step S202, and step S203, the determination unit 13 determines that the tracking frame number 32 has not reached the threshold frame number Md (= 3), and the determination unit 13 stores the coordinate information in the coordinate information storage unit 12. The tracking point information 122 thus set is set in the tracking point information 62d shown in FIG.

  Next, when the detection unit 10 does not detect a new instruction input, the determination unit 13 determines that there is an undetermined tracking point in step S <b> 105 of FIG. 4, and the determination unit 13 stores it in the coordinate information storage unit 12. The tracking point information 122 that has been set is set in the tracking point information 62e shown in FIG.

  Next, in step S103, step S202, and step S203, the determination unit 13 determines that the tracking frame number 32 has reached the threshold frame number Md (= 3), and the current frame coordinates 33 of the tracking point information 52e and Of the past frame coordinates 34, it is determined that the number of setting states has not reached the threshold frame number Nd (= 2), and the determination unit 13 uses the tracking point information 122 stored in the coordinate information storage unit 12 as shown in FIG. The tracking point information 62f shown in FIG.

(Specific example 4)
FIG. 10 is a diagram for explaining an example of continuation of a move by coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention.

  In FIG. 10, the frame 71 represents a frame that is being moved after the down determination, and the crosses and coordinates shown in the frame 71 represent the coordinates of the indicated position detected by the detection unit 10 in the frame 71. Also, the dotted x mark represents the coordinates (51, 102) of the indicated position detected in the previous frame. In FIG. 10, the current state 31, the number of tracking frames 32, the current frame coordinates 33, and the past frame coordinates 34 of the tracking point information 122 stored in the coordinate information storage unit 12 correspond to the frame 71. The state of changing is shown (72a-72b).

  First, when the detection unit 10 detects the coordinates (30, 150) of the designated position of the frame 71, if the tracking unit 11 determines in step S101 in FIG. 4 that there is no near tracking point, the tracking unit 11 in step S202 The tracking point information 122 stored in the coordinate information storage unit 12 is set in the tracking point information 72a shown in FIG.

  Next, in step S103 and step S207 of FIG. 5, the determination unit 13 determines that there is a current frame coordinate 33, and the determination unit 13 uses the tracking point information 122 stored in the coordinate information storage unit 12 as shown in FIG. The tracking point information 72b shown is set.

(Specific example 5)
FIG. 11 is a diagram for explaining an example of up determination by coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention. Here, the threshold frame number Nu will be described as 2.

  In FIG. 11, a frame 81a and a frame 81b represent two frames that are temporally continuous, and the dotted x mark in each frame indicates the coordinates of the indicated position detected in the past frame. This represents a state in which no new designated position exists near the coordinates of the designated position in the current frame. Further, in FIG. 11, the current state 31, tracking frame number 32, current frame coordinates 33, and past frame coordinates 34 of the tracking point information 122 stored in the coordinate information storage unit 12 correspond to the frames 81a and 81b. The state of changing with time is shown (82a to 82d).

  First, when the detection unit 10 does not detect a new instruction input, the determination unit 13 determines that there is an undetermined tracking point in step S <b> 105 of FIG. 4, and the determination unit 13 is stored in the coordinate information storage unit 12. The tracking point information 122 is set in the tracking point information 82a shown in FIG.

  Next, in step S106 and step S207, the determination unit 13 determines that the current frame coordinates 33 are not set, and the determination unit 13 uses the tracking point information 122 stored in the coordinate information storage unit 12 as shown in FIG. To the tracking point information 82b shown in FIG.

  Next, when the detection unit 10 does not detect a new instruction input, the determination unit 13 determines that there is an undetermined tracking point in step S <b> 105 of FIG. 4, and the determination unit 13 stores it in the coordinate information storage unit 12. The tracking point information 122 thus set is set in the tracking point information 82c shown in FIG.

  Next, in step S106, step S210, and step S211, the determination unit 13 determines that there is no current frame coordinate 33, and the number of unset states among the current frame coordinates 33 and the past frame coordinates 34 is the threshold frame. The determination unit 13 determines that the number Nu (= 2) has been reached, and sets the tracking point information 122 stored in the coordinate information storage unit 12 to the tracking point information 82d illustrated in FIG.

(Specific example 6)
FIG. 12 is a diagram for explaining an example of move return by coordinate processing executed by the coordinate processing apparatus 100 according to Embodiment 1 of the present invention. Here, the threshold frame number Nu will be described as 2.

  In FIG. 12, a frame 91a and a frame 91b represent two frames that are temporally continuous, and the crosses and coordinates shown in the frame 91b represent the coordinates of the indicated position detected by the detection unit 10. . Also, the dotted x mark in the frame 91a indicates the coordinates of the designated position detected in the past frame, and represents the state where no new designated position exists near the coordinates of the designated position in the current frame. . Further, in FIG. 12, the current state 31, tracking frame number 32, current frame coordinates 33, and past frame coordinates 34 of the tracking point information 122 stored in the coordinate information storage unit 12 correspond to the frames 91a and 91b. The state of changing with time is shown (92a to 92d).

  First, when the detection unit 10 does not detect a new instruction input, the determination unit 13 determines that there is an undetermined tracking point in step S <b> 105 of FIG. 4, and the determination unit 13 is stored in the coordinate information storage unit 12. The tracking point information 122 is set to the tracking point information 92a shown in FIG.

  Next, in step S103 and step S207 of FIG. 5, the determination unit 13 determines that there is no current frame coordinate 33, and the determination unit 13 uses the tracking point information 122 stored in the coordinate information storage unit 12 in FIG. The tracking point information 92b shown is set.

  Next, when the detection unit 10 detects the coordinates (31, 151) of the designated position of the frame 91b, the tracking unit 11 determines that there is a nearby tracking point in step S101, and the tracking unit 11 stores the coordinates in the coordinate information storage unit 12. The stored tracking point information 122 is set in the tracking point information 92c shown in FIG.

  Next, in step S103 and step S210 of FIG. 5, the determination unit 13 determines that there is a current frame coordinate 33, and the determination unit 13 stores the tracking point information 122 stored in the coordinate information storage unit 12 in FIG. The tracking point information 92d shown is set.

  As described above, according to the coordinate processing apparatus 100 according to the first embodiment of the present invention, even when erroneous detection or detection omission due to noise occurs in an apparatus equipped with a touch panel, drag operation, rotation operation, enlargement / reduction, etc. Continuous operation such as operation can be performed correctly. In addition, even if touch detection is performed because the user has unintentionally touched the touch panel device, or when the touch panel device is weakly pressed and a detection failure occurs, an unintended false detection or detection failure may occur. As a result, continuous operations such as a drag operation, a rotation operation, and an enlargement operation can be performed correctly.

  In the first embodiment of the present invention, as an instruction for a user to input an instruction to touch panel 500, a finger or a pen touches (touches) touch panel 500, moves (contacts and moves), Although it is premised on the case of up (release after contact movement), the present invention is not limited to this. For example, when the touch panel 500 includes a light sensor, the touch input is started by using an indicator capable of emitting light such as an LED pen, and the touch is started. It can be applied in association with the end of input.

  In addition, when the touch panel 500 is equipped with a heat sensor, the touch is started by inputting heat by using an indicator capable of generating heat such as a heat-generating pen to start heat input, the heat is continuously input, and the heat is heated up. It can be applied in association with the end of input.

  Further, when the touch panel 500 includes a sound sensor, the touch input is started and the move is continued to be input and controlled by controlling the presence or absence of sound input using an indicator capable of generating sound waves such as a pen speaker. It can be applied in association with the end of sound input.

  That is, as described above, the pointing object is not limited to a finger or a pen, and various cases such as light, heat, and sound can be considered. Also, the event is not limited to the case of touching the touch panel 500, and even in the case of non-contact, coordinate processing (event that is robust against false detection and detection omission) by associating various events. Determination process).

  In the first embodiment of the present invention, the case where the tracking point identifier and coordinates are output in association with the down, move and up events has been described. However, it is not necessary to output both the identifier and the coordinates. Instead, for example, according to a program or apparatus that uses event output information such as an application program, only the event or a combination of an event and an identifier, an event and a coordinate may be output.

  In the first embodiment of the present invention, when the down is determined, when the number of tracking frames 32 reaches the threshold frame number Md, the current frame coordinates 33 and the past of the tracking point information 122 corresponding to the coordinates are recorded. In the frame coordinate 34, the case where the down is confirmed when the number of set states is equal to or greater than the threshold frame number Nd has been described. However, the determination is made without waiting for the tracking frame number 32 to reach the threshold frame number Md. May be. For example, down may be determined when the number of setting states reaches the threshold frame number Nd among the current frame coordinates 33 and the past frame coordinates 34 of the tracking point information 122.

  The coordinate processing apparatus 100 according to the first embodiment of the present invention may be implemented by hardware using an integrated circuit or the like, or may be implemented by software using a CPU or the like.

  When the coordinate processing apparatus 100 according to the first embodiment of the present invention is implemented by hardware, each unit of the coordinate processing apparatus 100 may be an integrated circuit that is individually integrated into one chip, or may include a part or all of them. It may be an integrated circuit made into one chip. These integrated circuits may be realized by a dedicated circuit or a general-purpose processor. For example, a Field Programmable Gate Array (FPGA) that can be programmed after manufacturing a semiconductor chip, or a reconfigurable processor that can reconfigure the connection and setting of cells inside the integrated circuit may be used.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In the second embodiment of the present invention, an embodiment in which the coordinate processing of the coordinate processing apparatus 100 is implemented by software will be described. The configuration will be described below with reference to the drawings.

  FIG. 13 is a block diagram showing a configuration of a computer system according to Embodiment 2 of the present invention. Hereinafter, the same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  In FIG. 13, a computer system 200 receives signals from a CPU 201, ROM 202, RAM 203, and touch panel 500 that process instructions of various programs, and communicates with the outside in order to transmit coordinate processing results. F unit 204, optical disk drive 205 into which optical disk 301 is inserted, magnetic disk drive 206 into which magnetic disk 302 is inserted, bus 207, coordinate information storage unit 12, setting unit 15, and first threshold storage unit 16 and a second threshold value storage unit 17. Note that the computer system 200 may further include a network adapter board that provides connection to a local area network (LAN).

  The CPU 201, the ROM 202, and the RAM 203 perform the above-described coordinate processing. The detection unit 10 and the tracking unit 11 perform detection of a signal output from the touch panel 500 and signal processing based on the detection signal by the coordinate processing program. , Functioning as a determination unit 13, a generation unit 14, and the like.

  A coordinate processing program for causing the computer system 200 to realize the function of the coordinate processing apparatus 100 is stored in the optical disc 301 or the magnetic disc 302 inserted into the optical disc drive 205 or the magnetic disc drive 206, and from the optical disc 301 or the magnetic disc 302, Alternatively, the program may be loaded directly into the RAM 203 via a network.

  This program includes a plurality of instructions that cause the computer system 200 to realize the functions of the coordinate processing apparatus 100. Some of the basic functions necessary to realize these functions are provided by an operating system (OS) or a third-party program running on the computer system 200 or various toolkit modules installed in the computer system 200. The Therefore, this program does not necessarily include all functions necessary for realizing the functions of the coordinate processing apparatus 100. This program only needs to include an instruction for executing control of the coordinate processing apparatus 100 by calling an appropriate function or “tool” in a controlled manner so as to obtain a desired result. The operation of computer system 200 is well known and will not be repeated here.

  Note that recording media on which programs for realizing the functions of the coordinate processing apparatus 100 are recorded are CD-ROM (Compact Disc Read Only Memory), MO (Magneto-Optical disc), MD (Mini Disc), and DVD ( The present invention is not limited to the optical disk 301 such as Digital Versatile Disc), and the magnetic disk 302 such as FD (flexible disk) and hard disk. Tapes such as magnetic tapes and cassette tapes, card-type recording media such as IC (Integrated Circuit) cards and optical cards, and semiconductors such as mask ROM, EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), and flash ROM It can be either memory. Further, a dedicated LSI and a computer or a microprocessor may be combined, or a part or all of them may be configured as one dedicated LSI.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the technical means disclosed in different embodiments can be appropriately combined. Such embodiments are also included in the technical scope of the present invention.

  The present invention can also be expressed as follows. That is, the coordinate processing device according to the present invention is a coordinate processing device that tracks the correspondence between points in time-series frames and outputs coordinate information based on the tracking result, and accepts coordinate input by an indicator. For each of the input unit, one or a plurality of input coordinate information, a coordinate tracking unit that tracks the tracking point, a tracking point storage unit that stores information about the tracking point, the state of the tracking point, and the coordinate information State transition determination means for determining an event type defined by the positional relationship between the coordinate input unit and the pointing object that indicates the pointing target according to the determined state transition result of the tracking point, and coordinate information. Coordinate output means for outputting.

  It is preferable that the state transition determination unit determines the determination of the coordinate information based on the coordinate information of the current frame and the coordinate information of one or more past frames.

  The type of state for which the state transition determination means determines the transition is a down monitoring state for determining the tracking point, a move state corresponding to continuation of the tracking point, or a tracking point disappearance determination Preferably any of the up-monitoring states are included.

  The state transition determination means means a down event that means confirmation of the tracking point, a move event that means continuation of the tracking point, or confirmation of disappearance of the tracking point according to the determination result of the state transition of the tracking point. It is preferable to determine an event output that includes either an up event or no event.

  Preferably, the state transition determination unit determines the down event output when the state transition is performed from the down monitoring state to the move state.

  In the down monitoring state, the state transition determination unit accumulates a predetermined number of frames of past frame coordinate information, and in the past frame coordinate information, when there are more than a predetermined number of neighboring coordinate information, It is preferable that the state transition to the move state.

  It is preferable that the state transition determination unit determines the move event output when self-transitioning from the move state to the move state, that is, when making a self-loop, or transitioning from the down monitoring state to the move state. .

  It is preferable that the state transition determination means self-transitions to the move state when the coordinates of the immediately preceding frame and the coordinates of the current frame are recognized as being close in the move state.

  The state transition determination means preferably determines the up event output when the disappearance of the tracking point is determined in the up monitoring state.

  The state transition determination means accumulates a predetermined number of past frame coordinate information in the up-monitoring state, and all of the accumulated past frame coordinate information is coordinate information indicating that there is no detected coordinate in the vicinity. In some cases, it is preferable to determine the disappearance of the tracking point.

  The present invention can be applied to a portable device having an intuitive operability including a display panel capable of touch input at a plurality of points, such as a touch panel, a touch screen, and a tablet.

It is a functional block diagram which shows the structure of the coordinate processing apparatus in Embodiment 1 of this invention. It is a figure for demonstrating frame information. It is a figure for demonstrating tracking point information. It is a flowchart for demonstrating operation | movement of the coordinate processing apparatus in Embodiment 1 of this invention (the 1). It is a flowchart for demonstrating operation | movement of the coordinate processing apparatus in Embodiment 1 of this invention (the 2). It is a figure which shows an example of a state transition automaton. It is a figure for demonstrating an example of the down determination by the coordinate process performed with the coordinate processing apparatus 100 in Embodiment 1 of this invention. It is a figure for demonstrating another example of the down determination by the coordinate process performed with the coordinate processing apparatus 100 in Embodiment 1 of this invention. It is a figure for demonstrating an example of the false detection avoidance by the coordinate process performed with the coordinate processing apparatus 100 in Embodiment 1 of this invention. It is a figure for demonstrating an example of the continuation of a move by the coordinate process performed with the coordinate processing apparatus 100 in Embodiment 1 of this invention. It is a figure for demonstrating an example of the up determination by the coordinate process performed with the coordinate processing apparatus 100 in Embodiment 1 of this invention. It is a figure for demonstrating an example of the movement return by the coordinate process performed with the coordinate processing apparatus 100 in Embodiment 1 of this invention. It is a block diagram which shows the structure of the computer system in Embodiment 2 of this invention.

Explanation of symbols

10 detection unit 11 tracking unit (tracking means)
12 Coordinate information storage unit 13 Determination unit (determination means)
14 Generation Unit 15 Setting Unit 16 First Threshold Storage Unit 17 Second Threshold Storage Unit 121 Frame Information 122 Tracking Point Information 201 CPU
202 ROM
203 RAM
204 I / F unit 205 Optical disk drive 206 Magnetic disk drive 207 Bus 301 Optical disk 302 Magnetic disk

Claims (11)

A tracking unit that arranges coordinate points represented by coordinates of an instruction position to be moved by an instruction input by a user on a continuous frame in time series, and tracks a correspondence between coordinate points between the frames;
A first state that is a standby state for starting the instruction input, a second state that is a movement state of an instruction position that is moved by the instruction input, and the instruction, which are defined in advance as a state of the user's instruction input; The use executed when a state transition between a plurality of states including a third state that is an input end standby state is determined based on a tracking result by the tracking unit and the determined state transition is performed A coordinate processing apparatus comprising: determination means for determining an instruction input operation by a person.   The tracking means associates coordinate points arranged in each of the different frames when a distance between coordinate points arranged in different frames is equal to or less than a predetermined distance. The coordinate processing apparatus described in 1.   The operation of the user's instruction input to be determined by the determination means includes a first operation indicating the start confirmation of the instruction input, a second operation indicating continuation of movement of the instruction position, and the end of the instruction input. The coordinate processing apparatus according to claim 1, further comprising a third operation representing confirmation.   The coordinate processing apparatus according to claim 3, wherein the determination unit determines the first operation when it is determined that the state transition from the first state to the second state.   The determination means has a number of frames in which the coordinate points are arranged by the tracking means equal to or more than a predetermined first frame number, and coordinates having other coordinate points associated with each other in the frames. It is determined that a transition from the first state to the second state is made when the number of frames in which points are arranged becomes equal to or greater than a predetermined second number of frames. 5. The coordinate processing apparatus according to any one of 4 above.   When the determination means determines that the state transition is from the second state to the second state, or when it is determined that the state transition is from the third state to the second state, the second operation The coordinate processing device according to claim 3, wherein the coordinate processing device is determined.   In the second state, when the coordinate points arranged in each of successive frames are associated with each other, the determination unit determines to transition from the second state to the second state. The coordinate processing apparatus according to any one of claims 1 to 6, wherein the coordinate processing apparatus is characterized in that:   In the third state, the determination unit determines in advance the number of frames in which coordinate points that do not have other coordinate points associated with each other are arranged among the frames in which coordinate points are arranged by the tracking unit. The coordinate processing apparatus according to claim 3, wherein the third operation is determined when the number of frames exceeds the third frame number.   The coordinate processing program for operating a computer as said each means of the coordinate processing apparatus of any one of Claims 1-8.   A computer-readable recording medium on which the coordinate processing program according to claim 9 is recorded. A tracking step of arranging coordinate points represented by coordinates of an instruction position to be moved by an instruction input of a user on a frame that is continuous in time series, and tracking an association of coordinate points between the frames;
A first state that is a standby state for starting the instruction input, a second state that is a movement state of an instruction position that is moved by the instruction input, and the instruction, which are defined in advance as a state of the user's instruction input; The use executed when a state transition between a plurality of states including a third state which is an input end standby state is determined based on a tracking result by the tracking step and the determined state transition is performed A coordinate processing method comprising: a determination step for determining an instruction input operation of the person.

Images