TW201715362A - System and method for predicting trajectory - Google Patents

Abstract

A system for predicting trajectory is run in an electronic device which includes a sensing construction for gesture recognition or virtual operation. The system for predicting trajectory is cooperated with the sensing construction for predicting route trajectory of the gesture operation on the electronic device. The system for predicting trajectory includes a starting-point detection module configured to detect a starting-point of the route trajectory, a read-out module configured to read out the first coordinate of the route trajectory spot, and a count module configured to a second coordinate of the route trajectory spot according to the starting-point and the first coordinate.

Description

Trajectory prediction system and trajectory prediction method

The present invention relates to a trajectory prediction system and a trajectory prediction method.

Touch screen technology is widely used as a human-machine dialogue mode because it is convenient and fast. When the user touches the touch screen, the processor processes the information received by the touch screen and performs an action. However, due to the delay of the display and the time required for the processor to process the information, there is a time delay in performing the action compared to the touch screen, especially when the touch operation is long, such as when the line is drawn, the display time and the touch time are delayed. More obvious. Also in the virtual reality device, the user's motion trajectory requires more calculations in the three-dimensional space, resulting in a significant time delay in the execution of the action.

In view of this, it is necessary to provide a trajectory prediction system and a trajectory prediction method.

A trajectory prediction system, running in an electronic device, having an inductive structure for recognizing a gesture or a virtual operation, the trajectory prediction system cooperating with the sensing structure for predicting a gesture operation occurring on the electronic device Route trajectory, the trajectory prediction system includes:

a starting point detecting module, configured to detect a starting point of the track of the route track;

a reading module for reading a coordinate of a predetermined number of track points after the start of the track; and

The trajectory calculation module is configured to calculate the coordinates of the subsequent trajectory points according to the coordinates of the starting point of the trajectory and the coordinates of the predetermined number of trajectory points after the starting point.

A trajectory prediction method, running in an electronic device, the electronic device having an inductive structure for recognizing a gesture or a virtual operation, the trajectory prediction method cooperating with the sensing structure for predicting a route trajectory of the electronic device, the trajectory Forecasting methods include:

Detect the starting point of the track

Reading the coordinates of a predetermined number of track points after the start of the track; and

The coordinates of the subsequent track points are calculated according to the coordinates of the starting point of the track and the coordinates of the predetermined number of track points after the starting point.

The trajectory prediction system and the trajectory prediction method of the present invention can calculate the coordinates of the subsequent trajectory points according to the coordinates of the starting point of the trajectory and the predetermined number of trajectory points after the starting point, thereby realizing the trajectory prediction to avoid the time delay of recalculating after the trajectory occurs.

1 is a hardware architecture diagram of an operating environment of an embodiment of a trajectory prediction system of the present invention.

2 is a schematic diagram of a predicted trajectory of the trajectory prediction system shown in FIG. 1.

3 is a flow chart of an embodiment of a trajectory prediction method of the present invention.

4 is a hardware architecture diagram of an operating environment of another embodiment of the trajectory prediction system of the present invention.

FIG. 5 is a schematic diagram of a predicted trajectory of the trajectory prediction system shown in FIG. 4.

FIG. 6 is a schematic diagram of a modified trajectory of the trajectory prediction system shown in FIG. 4.

7 is a flow chart of another embodiment of a trajectory prediction method of the present invention.

Please refer to FIG. 1. FIG. 1 is a schematic diagram of a hardware architecture of an operating environment of an embodiment of the trajectory prediction system 10 of the present invention. The trajectory prediction system 10 is applied to the electronic device 100. In this embodiment, the electronic device 100 may be, but not limited to, a smart phone, a personal digital assistant (PDA), a tablet computer, and a mobile internet device (MID), a virtual reality device (Virtual Reality), and the like. The trajectory prediction system 10 is configured to predict a route trajectory of a user operating the electronic device 100. In this embodiment, the electronic device 100 is an electronic device with a touch function. The touch function is implemented by the touch screen 101. The touch screen 101 can be an in-cell touch screen or an external display. touch screen. The trajectory prediction system 10 can cooperate with the sensing structure of the touch screen 101 of the electronic device 100 to sense the gesture operation, and drive the chip through the touch sensing of the electronic device 100 to obtain the basic data required for prediction. The touch sensing driving chip reads the sensing signal sensed by the touch screen 101 and analyzes the coordinate position of the touch point and the touch action form according to the sensing signal, such as sliding touch or click touch. When it is determined that the touch operation is a sliding touch, the trajectory prediction system 10 is triggered to be activated. In other embodiments, the electronic device 100 is a virtual reality device for sensing a trajectory of a virtual operation of a user's head, eyes, hands, etc., when the electronic device 100 determines that the user moves through a non-starting point, The trajectory prediction system 10 is triggered to start.

The trajectory prediction system 10 includes a starting point detection module 12, a reading module 14 and a trajectory calculation module 16. The trajectory prediction system 10 can be solidified in the operating system of the electronic device 100, or stored in the memory 104 of the electronic device 100, and executed by the processor 102 of the electronic device 100 to predict the user operating the electronic device 100. Route trajectory. In this embodiment, the sensing structure of the touch screen senses a gesture operation occurring on the touch screen and converts the touch operation into a sensing signal for transmitting to the touch sensing driving chip, and the touch sensing driving chip analyzes the The signal is obtained by the processor 102 to obtain the basic data including the touch point coordinate position and the touch action form, so that the processor 102 executes the trajectory prediction system 10.

Please refer to FIG. 2 together. FIG. 2 is a schematic diagram of the predicted trajectory of the trajectory prediction system 10 shown in FIG. 1. The starting point detecting module 12 is configured to detect the starting point of the track. In the present embodiment, the trajectory on the prediction plane, such as the touch trajectory on the touch screen, is described, but is not limited to a plane, and the virtual reality device applied in the three-dimensional space is also applicable. The origin detection module 12 detects the start point of the locus L1 and records the start point as the first point P1 and the coordinates as (X1, Y1).

The reading module 14 reads the coordinates of a predetermined number of track points after the start of the track L1. In this embodiment, the reading module 14 reads the coordinates of the two track points after the starting point and records them as the second point P2 and the third point P3 and respectively records them as P2 (X2, Y2) and P3 (X3, Y3). ).

The trajectory calculation module 16 is configured to calculate coordinates of the subsequent trajectory points according to the trajectory starting point and a predetermined number of trajectory point coordinates after the starting point. Specifically, the distance between adjacent track points is defined as D(n)=((Xn-X(n-1))^2+(Yn-Y(n-1))^2)^0.5, adjacent tracks The slope S(n) between points = (Yn-Y(n-1))/((Xn-X(n-1)). And D(n)=2*D(n-1)-D( N-2), S(n)=2*S(n-1)-S(n-2), where n represents the nth point of the trajectory L1. Since the start point of the trajectory L1 and the second trajectory point after the start point The coordinates are (X1, Y1), (X2, Y2), (X3, Y3), so the coordinates (X4, Y4) of the fourth point P4 can be obtained according to the coordinates of the first to third points described above, and then The fifth point P5 (X5, Y5) and the sixth point P6 (X6, Y6) are calculated. In the embodiment, the number of predicted coordinate points is determined according to the delay time of the electronic device 100 and every two adjacent track points. The interval time is determined. If the delay time of the electronic device 100 is 80 ms and the interval time between every two adjacent track points is 6.6 ms, then the track L1 has a total of 12 points, that is, 9 points need to be predicted.

The trajectory prediction system 10 displays the coordinates of the subsequent trajectory points of the calculation on the touch screen 101.

Please refer to FIG. 3 together. FIG. 3 is a flowchart of an embodiment of a trajectory prediction method according to the present invention.

In step S201, the starting point detecting module 12 is configured to detect the starting point of the track. In the present embodiment, the trajectory on the prediction plane, such as the touch trajectory on the touch screen, is described, but is not limited to a plane, and the virtual reality device applied in the three-dimensional space is also applicable. The origin detection module 12 detects the start point of the locus L1 and records the first point P1 and the coordinates (X1, Y1).

In step S203, the reading module 14 reads the coordinates of the predetermined number of track points after the start of the track L1. In this embodiment, the reading module 14 reads the coordinates of the two track points after the starting point and records them as the second point P2 and the third point P3 and respectively records them as P2 (X2, Y2) and P3 (X3, Y3). ).

In step S205, the trajectory calculation module 16 is configured to calculate the coordinates of the subsequent trajectory points according to the starting point of the trajectory and a predetermined number of trajectory point coordinates after the starting point. Specifically, the distance between adjacent track points is defined as D(n)=((Xn-X(n-1))^2+(Yn-Y(n-1))^2)^0.5, adjacent tracks The slope S(n) between points = (Yn-Y(n-1))/((Xn-X(n-1)). And D(n)=2*D(n-1)-D( N-2), S(n)=2*S(n-1)-S(n-2), since the coordinates of the starting point of the locus L1 and the two locus points after the starting point are (X1, Y1), respectively X2, Y2), (X3, Y3), so the coordinates (X4, Y4) of the fourth point P4 can be calculated according to the coordinates of the first to third points described above, and then the fifth point P5 (X5, Y5) is sequentially calculated. The sixth point P6 (X6, Y6). In this embodiment, the number of predicted coordinate points is determined according to the delay time of the electronic device 100 and the interval time of each two adjacent track points, such as the delay time of the electronic device 100. For 80 ms and the interval between every two adjacent track points is 6.6 ms, then the track L1 has a total of 12 points, that is, 9 points need to be predicted.

The trajectory prediction method further includes displaying coordinates of the subsequent trajectory points of the calculation on the touch screen 101.

Please refer to FIG. 4. FIG. 4 is a schematic diagram of a hardware architecture of another embodiment of the trajectory prediction system 30 of the present invention. The trajectory prediction system 30 is applied to the electronic device 300. In this embodiment, the electronic device 300 may be, but not limited to, a smart phone, a personal digital assistant (PDA), a tablet computer, and a mobile internet device (MID), a virtual reality device (VR), and the like. The trajectory prediction system 30 is configured to predict a route trajectory of a user operating the electronic device 300. In this embodiment, the electronic device 300 is an electronic device with a touch function. The touch function is implemented by the touch screen 301. The touch screen 301 can be an in-cell touch screen or an external touch. Control screen to achieve. The trajectory prediction system 30 can be implemented by the touch sensing driving chip of the electronic device 300. The touch sensing driving chip reads the sensing signal sensed by the touch screen 301 and analyzes the coordinate position of the touch point according to the sensing signal. Touch the action form, such as swiping a touch or tapping a touch. When it is determined that the touch operation is a sliding touch, the trajectory prediction system 30 is triggered to be activated. In other embodiments, the electronic device 300 is a virtual reality device for sensing a user's head, eyes, hands, and the like. When the electronic device 300 determines that the user moves through a non-starting point, the trajectory prediction system 30 is triggered to start.

The trajectory prediction system 30 includes a starting point detection module 32, a reading module 34, a trajectory calculation module 36, and a trajectory correction module 38. The trajectory prediction system 30 can be solidified in the operating system of the electronic device 300, or stored in the memory 304 of the electronic device 300, and executed by the processor 302 of the electronic device 300 to predict the user operating the electronic device 300. Route trajectory.

Please refer to FIG. 5 together. FIG. 5 is a schematic diagram of the predicted trajectory of the trajectory prediction system shown in FIG. 4. The starting point detecting module 32 is configured to detect the starting point of the track. In the present embodiment, the trajectory on the prediction plane, such as the touch trajectory on the touch screen, is described, but is not limited to a plane, and the virtual reality device applied in the three-dimensional space is also applicable. The start point detecting module 32 detects the start point of the predicted trajectory L11 and records the starting point as the first point P11 and the coordinates are (x1, y1).

The reading module 34 reads the coordinates of the predetermined number of track points after the start of the predicted track L11. In the present embodiment, the reading module 34 reads the coordinates of the two track points after the starting point and records them as the second point P12 and the third point P13 and respectively records them as P12 (x2, y2), P13 (x3, y3). ).

The trajectory calculation module 36 is configured to calculate coordinates of the subsequent trajectory points according to the trajectory starting point and a predetermined number of trajectory point coordinates after the starting point. Specifically, the distance between adjacent track points is defined as D(n)=((xn-x(n-1))^2+(yn-y(n-1))^2)^0.5, adjacent tracks The slope S(n) between points = (yn-y(n-1))/((xn-x(n-1))) and D(n)=2*D(n-1)-D( N-2), S(n)=2*S(n-1)-S(n-2), since the starting point of the predicted trajectory L11 and the coordinates of the second trajectory point after the starting point are (x1, y1), (x2, y2), (x3, y3), so the coordinates (x4, y4) of the fourth point P14 can be calculated according to the coordinates of the first to third points described above, and then the fifth point P15 (x5, y5) is sequentially calculated. The sixth point P16 (x6, y6). In this embodiment, the number of predicted coordinate points is determined according to the delay time of the electronic device 300 and the interval time of each two adjacent track points, such as the delay of the electronic device 300. When the time is 80ms and the interval between every two adjacent track points is 6.6ms, the predicted track L11 has a total of 12 points, that is, 9 points need to be predicted.

Please refer to FIG. 6 together. FIG. 6 is a schematic diagram of the modified trajectory of the trajectory prediction system shown in FIG. 4. The trajectory correction module 38 corrects the predicted trajectory L11 according to the subsequent actual point coordinates of the predetermined number of trajectory points. Specifically, when the fourth point P14 of the user operation trajectory is (x4', y4'), the trajectory correction module 38 according to the formula D(n)=((xn-x(n-1))^2 +(yn-y(n-1))^2)^0.5, the slope between adjacent track points S(n)=(yn-y(n-1))/((xn-x(n-1) )), and D(n)=2*D(n-1)-D(n-2), S(n)=2*S(n-1)-S(n-2) the fifth point P15, the coordinates of the sixth point P16 are corrected to (x5', y5'), (x6', y6'), and when the fifth coordinate of the user's operation trajectory is different from the fifth coordinate of the predicted trajectory L11, The trajectory correction module 38 also corrects the coordinates of the sixth point P16 of the predicted trajectory.

The trajectory prediction system 10 displays the coordinates of the corrected subsequent trajectory points on the touch screen 301.

Please refer to FIG. 7, which is a flowchart of another embodiment of the trajectory prediction method of the present invention.

In step S401, the starting point detecting module 32 is configured to detect the starting point of the track. In the present embodiment, the trajectory on the prediction plane, such as the touch trajectory on the touch screen, is described, but is not limited to a plane, and the virtual reality device applied in the three-dimensional space is also applicable. The start point detecting module 32 detects the starting point of the trajectory L11 and records the first point P11 and the coordinates are (x1, y1).

In step S403, the reading module 34 reads the coordinates of the predetermined number of track points after the start of the track L11. In the present embodiment, the reading module 34 reads the coordinates of the two track points after the starting point and records them as the second point P12 and the third point P13 and respectively records them as P12 (x2, y2), P13 (x3, y3). ).

In step S405, the trajectory calculation module 36 is configured to calculate the coordinates of the subsequent trajectory points according to the trajectory starting point and a predetermined number of trajectory point coordinates after the starting point. Specifically, the distance between adjacent track points is defined as D(n)=((xn-x(n-1))^2+(yn-y(n-1))^2)^0.5, adjacent tracks The slope S(n) between points = (yn-y(n-1))/((xn-x(n-1))) and D(n)=2*D(n-1)-D( N-2), S(n)=2*S(n-1)-S(n-2), since the starting point of the predicted trajectory L11 and the coordinates of the second trajectory point after the starting point are (x1, y1), (x2, y2), (x3, y3), so the coordinates (x4, y4) of the fourth point P14 can be calculated according to the coordinates of the first to third points described above, and then the fifth point P15 (x5, y5) is sequentially calculated. The sixth point P16 (x6, y6). In this embodiment, the trajectory prediction system 30 predicts that the number of coordinate points is determined according to the delay time of the electronic device 300 and the interval time between each two adjacent track points, such as an electron. The delay time of the device 300 is 80 ms, and when the interval time between two adjacent track points is 6.6 ms, the predicted track L11 has a total of 12 points, that is, 9 points need to be predicted.

In step S407, the trajectory correction module 38 corrects the predicted trajectory L11 according to the subsequent actual point coordinates of the predetermined number of track points. Specifically, when the fourth point P14 of the user operation trajectory is (x4', y4'), the trajectory correction module 38 according to the formula D(n)=((xn-x(n-1))^2 +(yn-y(n-1))^2)^0.5, the slope between adjacent track points S(n)=(yn-y(n-1))/((xn-x(n-1) )), and D(n)=2*D(n-1)-D(n-2), S(n)=2*S(n-1)-S(n-2) the fifth point P15, the coordinates of the sixth point P16 are corrected to (x5', y5'), (x6', y6'), and when the fifth coordinate of the user's operation trajectory is different from the fifth coordinate of the predicted trajectory L11, The trajectory correction module 38 also corrects the sixth point coordinate of the predicted trajectory.

The trajectory prediction system and the trajectory prediction method of the present invention can predict the trajectory according to a predetermined number of point coordinates after the start point of the trajectory and the starting point, thereby avoiding the time delay of recalculation after the trajectory occurs. Further, the trajectory prediction system of the present invention may further correct the predicted trajectory L11 according to the subsequent real point coordinates of the predetermined number of trajectory points to improve the accuracy of the trajectory prediction.

In summary, the present invention has indeed met the requirements of the invention patent, and has filed a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiments, and those skilled in the art will be able to make equivalent modifications or variations in accordance with the spirit of the present invention. It should be covered by the following patent application.

100, 300‧‧‧ electronic devices

10, 30‧‧‧ trajectory prediction system

12, 32‧‧‧ starting point detection module

14, 34‧‧‧ Reading module

16, 36‧‧‧ Track Calculation Module

38‧‧‧Track Correction Module

101, 301‧‧‧ touch screen

104, 304‧‧‧ memory

102, 302‧‧‧ processor

S201~S205, S401~S407‧‧‧ steps

no

100‧‧‧Electronic devices

10‧‧‧Track Prediction System

12‧‧‧ starting point detection module

14‧‧‧Reading module

16‧‧‧Track Calculation Module

104‧‧‧ memory

102‧‧‧Processor

101‧‧‧ touch screen

Claims (10)

A trajectory prediction system, running in an electronic device, having an inductive structure for recognizing a gesture or a virtual operation, the trajectory prediction system cooperating with the sensing structure for predicting a gesture operation occurring on the electronic device Route trajectory, the trajectory prediction system includes:
a starting point detecting module, configured to detect a starting point of the track of the route track;
a reading module, configured to read a coordinate of a predetermined number of track points after the start of the track; and a track calculation module, configured to calculate a coordinate of the subsequent track point according to the coordinates of the starting point of the track and a predetermined number of track points after the starting point. The trajectory prediction system according to claim 1, wherein the starting point detecting module detects a starting point of the trajectory and records the starting point as a first point. The trajectory prediction system of claim 2, wherein the reading module reads the coordinates of the two trajectory points after the starting point. The trajectory prediction system according to claim 3, wherein the trajectory calculation module defines a distance D(n)=((Xn-X(n-1))^2+(Yn) between adjacent trajectory points. -Y(n-1))^2)^0.5, the slope S(n) between adjacent track points = (Yn-Y(n-1))/((Xn-X(n-1)), And D(n)=2*D(n-1)-D(n-2), S(n)=2*S(n-1)-S(n-2), where n represents the trajectory At n points, the trajectory calculation module calculates the coordinates of each point in the trajectory according to the above formula. The trajectory prediction system of claim 4, wherein the trajectory prediction system further comprises a trajectory correction module, configured to correct the trajectory according to the subsequent actual point coordinates of the predetermined number of trajectory points. A trajectory prediction method, running in an electronic device, the electronic device having an inductive structure for recognizing a gesture or a virtual operation, the trajectory prediction method cooperating with the sensing structure for predicting a route trajectory of the electronic device, the trajectory Forecasting methods include:
Detect the starting point of the track
Reading a coordinate of a predetermined number of track points after the start point of the track; and calculating a coordinate of the subsequent track point according to the coordinates of the start point of the track and a predetermined number of track points after the start point. The trajectory prediction method according to claim 6, wherein the starting point of the trajectory is detected and the starting point is recorded as the first point of the trajectory. The trajectory prediction method according to claim 7, wherein the coordinates of the two trajectory points after the starting point are read. The trajectory prediction method according to claim 8, wherein the distance between adjacent trajectory points is defined as D(n)=((Xn-X(n-1))^2+(Yn-Y(n- 1))^2)^0.5, the slope S(n) between adjacent track points = (Yn-Y(n-1))/((Xn-X(n-1)), and D(n) =2*D(n-1)-D(n-2), S(n)=2*S(n-1)-S(n-2), where n represents the nth point of the trajectory, according to the above The formula calculates the coordinates of each point in the trajectory. The trajectory prediction method of claim 9, wherein the trajectory prediction method further comprises correcting the trajectory according to a subsequent actual point coordinate of the predetermined number of trajectory points.