TWI552025B - Pattern matching method and touch integrated circuit - Google Patents

Pattern matching method and touch integrated circuit Download PDF

Info

Publication number
TWI552025B
TWI552025B TW104115141A TW104115141A TWI552025B TW I552025 B TWI552025 B TW I552025B TW 104115141 A TW104115141 A TW 104115141A TW 104115141 A TW104115141 A TW 104115141A TW I552025 B TWI552025 B TW I552025B
Authority
TW
Taiwan
Prior art keywords
comparison
standard
input
vector
input mode
Prior art date
Application number
TW104115141A
Other languages
Chinese (zh)
Other versions
TW201606577A (en
Inventor
鄭哲溶
姜會植
Original Assignee
瑞尼斯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 瑞尼斯股份有限公司 filed Critical 瑞尼斯股份有限公司
Publication of TW201606577A publication Critical patent/TW201606577A/en
Application granted granted Critical
Publication of TWI552025B publication Critical patent/TWI552025B/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)
  • Character Discrimination (AREA)

Description

模式匹配方法以及觸摸積體電路 Pattern matching method and touch integrated circuit

本發明是關於一種為了識別使用者電器的使用者手勢輸入的方法及相關的電腦軟體和設備。 The present invention relates to a method for recognizing a user's gesture input for a user's appliance and related computer software and equipment.

使用智能手機等可攜式使用者電器時,當手指等接觸畫面、輸入事先設定好的模式時,用來識別此模式的技術隨即被導入。為了識別此類模式,在一定的時間間隔內抽樣觸摸位置並將其儲存,拿儲存好的一系列觸摸位置與事先儲存的標準模式進行比較,從而判斷輸入的模式與儲存的標準模式是否相似。 When a portable user device such as a smartphone is used, when a finger or the like touches a screen and inputs a mode set in advance, the technique for recognizing this mode is immediately introduced. In order to identify such patterns, the touch locations are sampled and stored for a certain time interval, and a stored series of touch locations are compared with a previously stored standard mode to determine whether the input mode is similar to the stored standard mode.

按照傳統的技術,為了能夠精準地完成對上述模式的識別,必須迅速地執行上述抽樣。此時,由於使用者電器的處理器速度較快,因此使用者電器的能量消耗會比較大。 According to the conventional technique, in order to accurately perform the recognition of the above modes, the above sampling must be performed promptly. At this time, since the processor speed of the user's electric appliance is relatively fast, the energy consumption of the user's electric appliance is relatively large.

另一方面,可攜式使用者電器由於其使用電池,所以對耗電量較為敏感。因此,為了讓使用者電器在鎖屏期間能夠把耗電量最小化就要降低時鐘速度。若在上述鎖屏模式中執行上述模式識別時,由於較低的處理器速度,將發生識別率非常低下的問題。 On the other hand, portable consumer appliances are sensitive to power consumption because they use batteries. Therefore, in order to allow the user's appliance to minimize power consumption during the lock screen, the clock speed is reduced. If the above pattern recognition is performed in the above-described lock screen mode, a problem that the recognition rate is extremely low will occur due to a lower processor speed.

本發明是為了提供一種模式匹配方式,即使在較低的處理器速度中也能夠提供準確的模式匹配結果。 The present invention is directed to providing a pattern matching method that provides accurate pattern matching results even at lower processor speeds.

根據本發明的一個觀點,所提供的模式匹配方法中,在完成輸入模式期間,不僅可以利用已獲得的座標,還可以利用各個座標間位移矢量的相關值。在有限的抽樣速度中取得的原始資訊是關於使用者輸入完成的座標,但把其加工後獲得的附加資訊將有很多種。本發明的此附加資訊中,特別是利用座標間的位移矢量來提高識別率,從而能夠提供簡單的模式識別計算程式。 According to one aspect of the present invention, in the provided pattern matching method, not only the obtained coordinates but also the correlation values of the displacement vectors between the respective coordinates can be utilized during the completion of the input mode. The raw information obtained at a limited sampling speed is a coordinate about the user's input completion, but there will be many additional information obtained after processing it. In this additional information of the present invention, in particular, the displacement vector between the coordinates is used to increase the recognition rate, thereby providing a simple pattern recognition calculation program.

根據本發明的另一觀點,所提供的模式匹配方法包括:在標準輸入模式中,作為抽樣的N個標準元組,分別包含標準輸入座標和標準關聯矢量,準備N個標準元組的階段;在比較輸入模式中,作為抽樣的M個比較元組,分別包含比較輸入座標和比較關聯矢量,準備M個比較元組的階段(但,M>=N);推測上述M個的比較元組中與上述N個的標準元組匹配的N個比較元組的階段;根據相互匹配的標準元組和比較元組對分別計算出標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的距離的階段;利用上述N個的標準元組和上述N個的比較元組獲得的N個的上述距離,利用上述距離中至少一段距離來確定上述標準輸入模式和上述比較輸入模式間的相似度的階段。 According to another aspect of the present invention, the provided pattern matching method includes: in a standard input mode, as a sampled N standard tuples, respectively including standard input coordinates and standard correlation vectors, and preparing phases of N standard tuples; In the comparison input mode, as the sampled M comparison tuples, respectively, including the comparison input coordinates and the comparison correlation vector, preparing the M comparison tuple stages (however, M>=N); presuming the above M comparison tuples a phase of N comparison tuples matching the above N standard tuples; respectively calculating a standard representative value of the standard correlation vector and a comparison representative value of the comparison correlation vector according to the matched standard tuple and the comparison tuple pair a phase of the distance; using the above N distances of the N standard tuples and the N comparison metablocks, using at least one of the distances to determine the similarity between the standard input mode and the comparison input mode The stage of the degree.

此時,上述推測階段包括:在屬於上述N個比較元組中 的M個比較輸入座標中,推測出具有從屬於上述N個的標準元組中的N個標準輸入座標開始,到最近的比較輸入座標的N個比較元組的階段。 At this time, the above speculative phase includes: among the N comparison tuples belonging to the above The M comparison input coordinates are presumed to have a phase from the N standard input coordinates belonging to the N standard tuples to the N comparison tuples of the most recent input input coordinates.

此時,上述標準關聯矢量的上下左右方向的趨向值就是上述標準關聯矢量,上述比較關聯矢量的上下左右方向的趨向值可以是上述比較關聯矢量。 In this case, the trend value in the up, down, left, and right directions of the standard correlation vector is the standard correlation vector, and the trend value in the up, down, left, and right directions of the comparison correlation vector may be the comparison correlation vector.

此時,上述比較代表值是上述比較關聯矢量,以及上述比較關聯矢量被抽樣前,被抽樣的、一個以上的其他比較關聯矢量的代表值。 In this case, the comparison representative value is the comparison correlation vector, and a representative value of one or more other comparison correlation vectors sampled before the comparison correlation vector is sampled.

此時,上述確定相似度的階段,包括一個階段,即:上述獲得的N個的距離中,若至少有一段距離超過事先設定的第1臨界值,就可以判斷上述標準輸入模式和上述比較輸入模式並不相似。 At this time, the phase of determining the similarity includes a phase, that is, if at least one of the N distances obtained exceeds a preset first threshold, the standard input mode and the comparison input may be determined. The patterns are not similar.

此時,上述確定相似度的階段,包括一個階段,即:上述獲得的N個的距離的代表值若超過事先設定的第2臨界值,就可以判斷上述標準輸入模式和上述比較輸入模式並不相似。 At this time, the phase of determining the similarity includes a phase, that is, if the representative value of the N distances obtained exceeds the second threshold set in advance, it can be determined that the standard input mode and the comparison input mode are not similar.

此時,模式匹配方法中所包含的各個階段,對觸摸屏設備中輸入的模擬信號進行處理,確定觸摸輸入位置;將上述確定的觸摸輸入位置的相關資訊傳遞到其他處理設備這些階段可在觸摸積體電路(觸摸IC)中被完成。 At this time, each stage included in the pattern matching method processes the analog signal input in the touch screen device to determine the touch input position; and transmits the relevant information of the determined touch input position to other processing devices at these stages in the touch product. The body circuit (touch IC) is completed.

此時,上述觸摸IC具有以第1處理器速度進行操作的第1模式,以及以比上述第1處理器速度快的第2處理器速度進行操作的第2模式,上述模式匹配方法中包含的各個階段可以在上述 第1模式下執行。 In this case, the touch IC includes a first mode that operates at a first processor speed and a second mode that operates at a second processor speed that is faster than the first processor speed, and is included in the pattern matching method. Each stage can be above Executed in the first mode.

此時,在上述標準輸入模式以及上述比較輸入模式中,其中一個是根據使用者在第1時間輸入後被事先儲存的模式,另一個是在上述第1時間後的第2時間被輸入的輸入模式。 At this time, one of the standard input mode and the comparison input mode is a mode that is previously stored after the user inputs the first time, and the other is an input that is input at the second time after the first time. mode.

根據本發明的另一個觀點所提供的觸摸IC,作為對觸摸屏設備中輸入的模擬信號進行處理,確定觸摸輸入位置;將上述確定的觸摸輸入位置的相關資訊傳遞到其他處理設備的觸摸IC,其包含的處理器能使下列階段順利進行:作為抽樣的N個標準元組,分別包含標準輸入座標和標準關聯矢量,準備N個標準元組的階段;在比較輸入模式中,作為抽樣的M個比較元組,分別包含比較輸入座標和比較關聯矢量,準備M個比較元組的階段(但,M>=N);推測上述M個的比較元組中與上述N個的標準元組匹配的N個比較元組的階段;根據相互匹配的標準元組和比較元組對分別計算出標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的距離的階段;利用上述N個的標準元組和上述N個的比較元組獲得的N個的上述距離,並利用其中至少一段距離來確定上述標準輸入模式和上述比較輸入模式間的相似度的階段。 According to another aspect of the present invention, a touch IC is processed as an analog signal input to a touch screen device to determine a touch input position; and the related information of the determined touch input position is transmitted to a touch IC of another processing device, The included processor enables the following stages to proceed smoothly: as a sample of N standard tuples, including standard input coordinates and standard correlation vectors, respectively, to prepare N standard tuple stages; in the comparison input mode, as M samples Comparing tuples, respectively, including comparing input coordinates and comparing correlation vectors, preparing phases of M comparison tuples (but, M>=N); presuming that the above M comparison tuples match the above-mentioned N standard tuples Stages of N comparison tuples; stages of calculating the standard representative value of the standard correlation vector and the distance between the comparison representative values of the comparison correlation vectors according to the matched standard tuple and the comparison tuple pair; using the above N criteria The above distances of the N obtained by the tuple and the N comparison tuples, and using at least one of the distances to determine the standard input mode and Said phase comparing similarity between the input pattern.

根據本發明的另一個觀點所提供的觸摸IC,其包含的處理器能使下列階段順利進行:作為在第1輸入模式中抽樣的N個的第1資訊,分別包含了第1座標和第1矢量的N個第1資訊的準備階段;作為在第2輸入模式中抽樣的M個的第2資訊,分別包含了第2座標和第2矢量的M個第2資訊的準備階段(但,M>=N);推測出上述M個第2資訊中與上述N個的第1資訊匹配 的N個第2資訊的階段;根據相互匹配的第1資訊和第2資訊對分別計算出第1矢量的第1代表值和第2矢量的第2代表值之間的距離的階段;利用上述N個的第1資訊和上述N個的第2資訊獲得的N個的上述距離,並利用其中至少一段距離來確定上述第1輸入模式和上述第2輸入模式之間的相似度的階段。 According to another aspect of the present invention, a touch IC includes a processor that can smoothly perform the following steps: as the first information of the N samples sampled in the first input mode, respectively including the first coordinate and the first The preparation stage of the N first information of the vector; the M pieces of the second information sampled in the second input mode include the preparation stages of the M pieces of the second information of the second coordinate and the second vector (however, M >=N); presuming that the M pieces of the second information match the first information of the N pieces a stage of N pieces of second information; a stage of calculating a distance between a first representative value of the first vector and a second representative value of the second vector based on the first information and the second information pair that match each other; The N first pieces of information and the N distances obtained by the N pieces of second information are used to determine a degree of similarity between the first input mode and the second input mode by using at least one of the distances.

根據本發明的另一觀點所提供的模式匹配方法,包括:在第1輸入模式中,推測出一個以上的抽樣第1座標間的第1位移矢量的第1推測階段;在第2輸入模式中,推測出一個以上的抽樣第2座標間的第2位移矢量的第2推測階段;上述第1位移矢量和上述第2位移矢量按照事先設定的規則相互匹配的階段;上述匹配完成的第1位移矢量和上述第2位移矢量的第1代表值和上述第2位移矢量的第2代表值間的距離,以此距離為基礎判斷出上述第1輸入模式和上述第2輸入模式間的相似度的階段。 According to another aspect of the present invention, a pattern matching method includes: estimating, in a first input mode, a first estimation phase of a first displacement vector between one or more sampling first coordinates; and in a second input mode Predicting a second estimation stage of the second displacement vector between the second coordinates of one or more samples; a stage in which the first displacement vector and the second displacement vector match each other according to a predetermined rule; and the first displacement of the matching is completed The vector and the distance between the first representative value of the second displacement vector and the second representative value of the second displacement vector determine the similarity between the first input mode and the second input mode based on the distance stage.

此時,上述第1位移矢量及上述第2位移矢量可表現出抽樣時間在時間軸上相互臨近的一對座標間的位移。 In this case, the first displacement vector and the second displacement vector may represent displacements between a pair of coordinates in which the sampling time is adjacent to each other on the time axis.

此時,上述第1位移矢量的個數比上述第2位移矢量的個數少,上述第1位移矢量僅可以與上述第2位移矢量中的一個匹配。 In this case, the number of the first displacement vectors is smaller than the number of the second displacement vectors, and the first displacement vector may match only one of the second displacement vectors.

此時,上述第1位移矢量的個數比上述第2位移矢量的個數少,上述第1位移矢量至少一個可以與上述第2位移矢量中的複數個匹配。 In this case, the number of the first displacement vectors is smaller than the number of the second displacement vectors, and at least one of the first displacement vectors may match a plurality of the second displacement vectors.

根據本發明將提供一種即使處理器操作速度慢,仍能提 供準確模式匹配結果的模式匹配法。 According to the present invention, it is provided that even if the processor operates at a slow speed, it can be provided Pattern matching method for accurate pattern matching results.

1‧‧‧軌跡 1‧‧‧ track

11‧‧‧慢速輸入模式(標準輸入模式) 11‧‧‧Slow input mode (standard input mode)

12‧‧‧快速輸入模式(比較輸入模式) 12‧‧‧Quick input mode (comparison input mode)

100‧‧‧使用者電器 100‧‧‧User appliances

110‧‧‧框架 110‧‧‧Frame

120‧‧‧觸摸輸入設備 120‧‧‧Touch input device

R(1,1)、R(2,2)、R(3,3)、R(4,4)、R(5,5)‧‧‧輸入座標(標準輸入座標) R(1,1), R(2,2), R(3,3), R(4,4), R(5,5)‧‧‧ input coordinates (standard input coordinates)

S(1,1)、S(2,2)、S(3,3)、S(4,4)、S(5,5)、S(6,6)、S(7,7)、S(8,8)、S(9,9)、S(10,10)‧‧‧輸入座標(比較輸入座標) S(1,1), S(2,2), S(3,3), S(4,4), S(5,5), S(6,6), S(7,7),S (8,8), S(9,9), S(10,10)‧‧‧ Input coordinates (comparison input coordinates)

S10、S20、S30、S40‧‧‧階段 S10, S20, S30, S40‧‧

t1~t10‧‧‧時間 T1~t10‧‧‧Time

TR(1,1)、TR(2,2)、TR(3,3)、TR(4,4)、TR(5,5)‧‧‧元組 TR(1,1), TR(2,2), TR(3,3), TR(4,4), TR(5,5)‧‧‧ tuples

VR(2,2)、VR(3,3)、VR(4,4)、VR(5,5)‧‧‧關聯矢量(標準關聯矢量) VR(2,2), VR(3,3), VR(4,4), VR(5,5)‧‧‧ association vector (standard association vector)

VS(2,2)、VS(3,3)、VS(4,4)、VS(5,5)、VS(6,6)、VS(7,7)、VS(8,8)、VS(9,9)、VS(10,10)‧‧‧關聯矢量(比較關聯矢量) VS(2,2), VS(3,3), VS(4,4), VS(5,5), VS(6,6), VS(7,7), VS(8,8),VS (9,9), VS(10,10)‧‧‧ association vector (comparison correlation vector)

圖1展示的是可攜式使用者電器中的觸摸輸入軌跡的實例。 Figure 1 shows an example of a touch input trajectory in a portable consumer appliance.

圖2(包括圖2A以及圖2B)是為了解釋說明手勢完成的情況下輸入模式的輸入座標的抽樣趨勢。 2 (including FIGS. 2A and 2B) is for explaining the sampling trend of the input coordinates of the input mode in the case where the gesture is completed.

圖3(包括圖3A、圖3B以及圖3C)是為了解釋說明為了執行根據本發明一個實施例的模式匹配,根據使用者手勢所獲得的輸入座標,利用此座標定義「模式資訊」的方法。 3 (including FIGS. 3A, 3B, and 3C) is for explaining the method of defining "mode information" using the coordinates in accordance with the input coordinates obtained by the user gesture in order to perform pattern matching according to an embodiment of the present invention.

圖4(包括圖4A以及圖4B)是為了解釋說明根據本發明一個實施例,利用輸入模式解釋被定義的關聯矢量。 Figure 4 (comprising Figures 4A and 4B) is for explaining the interpretation of the defined association vector using the input mode in accordance with one embodiment of the present invention.

圖5(包括圖5A、圖5B、圖5C以及圖5D)是為了解釋說明根據本發明一個實施例所提供的、為了生成元組的事前處理器。 Figure 5 (comprising Figures 5A, 5B, 5C, and 5D) is for the purpose of explaining an advance processor for generating tuples in accordance with one embodiment of the present invention.

圖6圖示的是根據本發明一個實施例所定義的標準元組和比較元組的比較結果。 Figure 6 illustrates a comparison of standard tuples and comparison tuples as defined in accordance with one embodiment of the present invention.

圖7圖示的是根據本發明一個實施例,執行的輸入模式間模式匹配執行方法的順序圖。 Figure 7 illustrates a sequence diagram of an inter-input mode mode matching execution method performed in accordance with one embodiment of the present invention.

以下,將參考圖面對本發明的實施例進行詳盡的解釋和說明。但本發明並不僅限於此次解釋說明的實施例,本發明能夠通過多種不同的形態體現。本發明說明書中使用的辭彙是為了幫助 理解本實施例,並不是用來限定本發明的。另外,下文中使用的單數形態同樣也包含了複數形態。 Hereinafter, the embodiments of the present invention will be explained and explained in detail with reference to the drawings. However, the present invention is not limited to the embodiments explained herein, and the present invention can be embodied in many different forms. The vocabulary used in the description of the present invention is to help This embodiment is not intended to limit the invention. In addition, the singular forms used hereinafter also include the plural forms.

圖1展示的是可攜式使用者電器中的觸摸輸入軌跡的實例。圖1中使用者電器(100)包括框架(110)和觸摸輸入設備(120)。觸摸輸入設備(120)也可以是與未圖示畫面重疊的狀態。而且此時,觸摸輸入設備(120)實際在可視光領域中,根據使用者可由透明的素材製成。軌跡(1)是使手指接觸觸摸輸入設備(120)並移動的路徑。上述使手指接觸觸摸輸入設備(120)並使其移動的行為被稱為手勢。完成上述手勢可快可慢。比如,同一個軌跡(1),快速描繪時,可視為完成「快速手勢」,緩慢描繪時,可視為完成「慢速手勢」。上述不管是快速還是慢速完成的使用者手勢被稱為「輸入模式」。由快速手勢完成的輸入模式被稱為「快速輸入模式」,由慢速手勢完成的輸入模式被稱為「慢速輸入模式」。 Figure 1 shows an example of a touch input trajectory in a portable consumer appliance. The user appliance (100) of Figure 1 includes a frame (110) and a touch input device (120). The touch input device (120) may be in a state of overlapping with a screen not shown. Moreover, at this time, the touch input device (120) is actually in the visible light field, and can be made of transparent material according to the user. The track (1) is a path that causes a finger to touch the touch input device (120) and move. The above-described behavior of touching a finger to the touch input device (120) and moving it is referred to as a gesture. The above gestures can be completed quickly or slowly. For example, the same track (1), when drawing quickly, can be regarded as completing the "quick gesture", and when drawing slowly, it can be regarded as completing the "slow gesture". The above-mentioned user gestures, whether completed quickly or slowly, are referred to as "input modes." The input mode completed by the quick gesture is called "fast input mode", and the input mode completed by the slow gesture is called "slow input mode".

圖2A圖示的是慢速手勢完成的輸入模式的輸入座標抽樣趨勢,圖2B圖示的是慢速手勢完成的輸入模式的輸入座標抽樣趨勢。 2A illustrates the input coordinate sampling trend of the input mode of the slow gesture completion, and FIG. 2B illustrates the input coordinate sampling trend of the input mode of the slow gesture completion.

圖2A及圖2B中,t1至t10指的是各個輸入座標的抽樣時間,這時假定按照相同的處理器速度進行操作。 In Figs. 2A and 2B, t1 to t10 refer to the sampling time of each input coordinate, and it is assumed that the operation is performed at the same processor speed.

假設使用者電器是按一定的處理器速度進行操作時,以不同速度完成相同形態的手勢,在完成各個手勢的期間可感知到不同個數的輸入座標。 Assuming that the user's appliance is operating at a certain processor speed, the same form of gesture is completed at different speeds, and different numbers of input coordinates are perceived during the completion of each gesture.

比如,圖2A圖示的是慢速輸入模式(11)經過時間t1~t10 完成的情況,圖2B圖示的是快速輸入模式(11)經過時間t1~t5完成的情況。圖2A中一個慢速輸入模式(11)一共能夠得到10個輸入座標(輸入座標樣品),圖2B中一個快速輸入模式(12)一共能夠得到5個輸入座標。 For example, Figure 2A illustrates the slow input mode (11) elapsed time t1~t10 In the case of completion, FIG. 2B illustrates the case where the fast input mode (11) is completed after the time t1 to t5. In Figure 2A, a slow input mode (11) can get a total of 10 input coordinates (input coordinate samples), and a fast input mode (12) in Figure 2B can get a total of 5 input coordinates.

圖2A中慢速輸入模式(11)所得到的輸入座標由S(i,i)(但,i=1,2,3,…,10)。 The input coordinates obtained in the slow input mode (11) in Fig. 2A are S(i, i) (however, i = 1, 2, 3, ..., 10).

表示,圖2B中快速輸入模式(12)所得到的輸入座標由R(j,j)(但,j=1,2,3,…,5)表示。 It is shown that the input coordinates obtained by the fast input mode (12) in Fig. 2B are represented by R(j, j) (however, j = 1, 2, 3, ..., 5).

<為了執行模式匹配而推測的資訊形態> <Information form presumed to perform pattern matching>

圖3(包括圖3A、圖3B以及圖3C)是為了解釋說明為了執行根據本發明一個實施例的模式匹配,根據使用者手勢所獲得的輸入座標,利用此座標定義「模式資訊」的方法。 3 (including FIGS. 3A, 3B, and 3C) is for explaining the method of defining "mode information" using the coordinates in accordance with the input coordinates obtained by the user gesture in order to perform pattern matching according to an embodiment of the present invention.

本發明書中「模式資訊」這一用語指的是為了比較兩個輸入模式而記錄在本發明中的特別類型資訊。本發明的一個實施例中,為了執行模式匹配可定義並使用本稱為「元組」的模式資訊。上述「元組」作為可數資訊,能夠生成與從輸入模式(11,12)中得到的輸入座標數相同的個數。比如,圖2B的快速輸入模式(12)中,由於生成了5個輸入座標R(j,j),因此可生成5個元組。 The term "mode information" in the present specification refers to a special type of information recorded in the present invention in order to compare two input modes. In one embodiment of the invention, mode information referred to as a "tuple" can be defined and used in order to perform pattern matching. The above-mentioned "tuple" as the countable information can generate the same number as the number of input coordinates obtained from the input mode (11, 12). For example, in the fast input mode (12) of FIG. 2B, since five input coordinates R(j, j) are generated, five tuples can be generated.

上述各個元組的構成可包括一個輸入座標和與其相關聯的關聯矢量。這裏的「關聯矢量」可在第1輸入座標抽樣之前的時間裏從抽樣的第2輸入座標中取得。特別是,此時上述第1輸入座標和相關聯的關聯矢量可以是上述第1輸入座標和上述第2輸入座標間的位移矢量或是此位移矢量的變形值。但是,關於輸入模 式,最初抽樣的最初輸入座標不能用來定義之前存在的輸入座標,因此與上述最初輸入座標相關的位移矢量並不存在。因此,可定義為沒有與上述最初輸入座標相關的位移矢量。以下,將通過例子對上述元組的概念進行說明。 The composition of each of the above tuples may include an input coordinate and an associated vector associated therewith. Here, the "association vector" can be obtained from the second input coordinate of the sample before the sampling of the first input coordinate. In particular, at this time, the first input coordinate and the associated correlation vector may be a displacement vector between the first input coordinate and the second input coordinate or a deformation value of the displacement vector. However, about the input mode The initial input coordinates of the initial sample cannot be used to define the input coordinates that existed before, so the displacement vector associated with the initial input coordinates described above does not exist. Therefore, it can be defined as a displacement vector that is not associated with the initial input coordinates described above. Hereinafter, the concept of the above tuple will be described by way of example.

圖3A圖示的是可對圖2B的快速輸入模式(12)的各個輸入座標R(j,j)之間連接的關聯矢量VR(j,j)進行定義(但,j=1,2,3,…,5)。而且,圖3B僅表現了關聯矢量VR(j,j)。 3A illustrates that an associated vector VR(j,j) can be defined for each input coordinate R(j,j) of the fast input mode (12) of FIG. 2B (however, j=1, 2, 3,...,5). Moreover, FIG. 3B only represents the correlation vector VR(j, j).

下列[表1]展示的是由圖3A中獲得的資訊所生成的一個元組組合的例子。 The following [Table 1] shows an example of a tuple combination generated by the information obtained in Fig. 3A.

上述關聯矢量可以是兩個輸入座標之間的實際位移值,但是上述實際位移值也可由僅僅通過方向性構成的「變形矢量」重新定義。上述變形矢量的生成法可參考圖3C進行說明。 The above correlation vector may be an actual displacement value between two input coordinates, but the above actual displacement value may also be redefined by a "deformation vector" composed only of directivity. The generation method of the above deformation vector can be explained with reference to FIG. 3C.

圖3C圖示的是為了推測上述關聯矢量方向性的標準方向。關聯矢量的水平成分傾向右側時可擔當+1值,傾向左側時可擔當-1值。另外,關聯矢量的豎直成分傾向上側時可擔當+1值,傾向下側時可擔當-1值。 Fig. 3C illustrates a standard direction for estimating the directivity of the above-described correlation vector. When the horizontal component of the correlation vector tends to the right side, it can assume a value of +1, and when it is inclined to the left side, it can take a value of -1. Further, the vertical component of the correlation vector may serve as the +1 value when it is inclined to the upper side, and may take the value of -1 when it is inclined to the lower side.

因此,表1的關聯矢量可重新定義為[表2]變形矢量。 Therefore, the correlation vector of Table 1 can be redefined as the [Table 2] deformation vector.

根據本發明的實施例中,可選擇並使用上述關聯矢量或變形矢量。 In accordance with an embodiment of the invention, the above described correlation vector or deformation vector may be selected and used.

圖4A圖示的是可對圖2A的慢速輸入模式(11)的各個輸入座標S(i,i)之間連接的關聯矢量VS(i,i)進行定義(但,i=1,2,3,…,10)。而且,圖4A僅表現了關聯矢量VS(i,i)。與圖3一樣,圖4A中獲得的資訊可定義與表3相同的一個元組組合。 4A illustrates that an association vector VS(i,i) connected between respective input coordinates S(i,i) of the slow input mode (11) of FIG. 2A can be defined (however, i=1, 2) , 3,...,10). Moreover, FIG. 4A only shows the correlation vector VS(i, i). As with Figure 3, the information obtained in Figure 4A can define the same tuple combination as Table 3.

根據本發明的一個實施例,為了判斷圖2A中的慢速輸入模式(11)與圖2B中的快速輸入模式(12)的相似度,可使用與圖3(包括圖3A、圖3B以及圖3C)及圖4(包括圖4A以及圖4B)相關,獲得的不同的組的元組。以下,將解釋說明用來判斷兩個輸入模式相似度的根據本發明一個實施例的方法。 According to an embodiment of the present invention, in order to determine the similarity between the slow input mode (11) in FIG. 2A and the fast input mode (12) in FIG. 2B, FIG. 3 (including FIG. 3A, FIG. 3B and FIG. 3C) and FIG. 4 (including FIG. 4A and FIG. 4B) are related to the obtained different sets of tuples. Hereinafter, a method according to one embodiment of the present invention for judging the similarity of two input modes will be explained.

<兩個模式中推測資訊的比較法> <Comparative method of speculative information in two modes>

圖5(包括圖5A、圖5B、圖5C以及圖5D)是為了解釋說明根據本發明一個實施例所提供的、為了生成元組的事前處理器。 Figure 5 (comprising Figures 5A, 5B, 5C, and 5D) is for the purpose of explaining an advance processor for generating tuples in accordance with one embodiment of the present invention.

如圖5A中的使用者電器(100),向使用者輸入設備中輸入兩個不同的手勢。第1個手勢是慢速輸入模式(11),而第2個手勢是快速輸入模式(12)。兩個手勢可以是同一個人意圖輸入的同一個手勢,但也可以不是。意圖同一個手勢時,兩個手勢的整體形象和大小雖然相近,但中心的位置也可能不同。 As shown in Figure 5A, the user appliance (100) inputs two different gestures into the user input device. The first gesture is the slow input mode (11), and the second gesture is the fast input mode (12). The two gestures can be the same gesture that the same person intended to input, but it can be no. When the same gesture is intended, the overall image and size of the two gestures are similar, but the position of the center may be different.

圖5B是把從慢速輸入模式(11)抽樣獲得的輸入座標(S(i,i))標示在慢速輸入模式(11)上,圖5C是把從快速輸入模式(12)抽樣獲得的輸入座標(R(j,j))標示在慢速輸入模式(12)上(i=1~10,j=1~5)。以下,把從慢速輸入模式(11)抽樣獲得的輸入座標(S(i,i))稱之為第1輸入座標,把從快速輸入模式(12)抽樣獲得的輸入座標(R(j,j))稱之為第2輸入座標 Fig. 5B shows the input coordinates (S(i, i)) obtained by sampling from the slow input mode (11) in the slow input mode (11), and Fig. 5C is the sample obtained from the fast input mode (12). The input coordinates (R(j, j)) are indicated in the slow input mode (12) (i = 1 to 10, j = 1 to 5). Hereinafter, the input coordinates (S(i, i)) obtained by sampling from the slow input mode (11) are referred to as the first input coordinates, and the input coordinates obtained from the fast input mode (12) are sampled (R(j, j)) called the 2nd input coordinate

圖5D是使輸入座標(S(i,i))中第一個輸入座標S(1,1)和輸入座標(R(j,j))第一個輸入座標R(1,1)的位置處於一致的狀態下,把上述輸入座標(S(i,i))和輸入座標(R(j,j))進行排列。觀 察圖5D的話,就夠分別掌握輸入座標(S(i,i))和輸入座標(R(j,j))之間的距離。 Figure 5D shows the position of the first input coordinate S(1,1) of the input coordinate (S(i,i)) and the first input coordinate R(1,1) of the input coordinate (R(j,j)). In the same state, the input coordinates (S(i, i)) and the input coordinates (R(j, j)) are arranged. View Looking at Figure 5D, it is enough to grasp the distance between the input coordinates (S(i, i)) and the input coordinates (R (j, j)).

本發明一個實施例中,為了測定兩個輸入模式的相似度,兩個輸入模式中的一個被當做「標準輸入模式」,另一個被當做「比較輸入模式」。此時。抽樣輸入座標個數較少的輸入模式將被當做標準輸入模式,另一個當做比較輸入模式。圖5的實施例中,設定第1輸入模式(11)為比較輸入模式,第2輸入模式(12)為標準輸入模式。以下,從標準輸入模式中得到的元組被稱為「標準元組」,從比較輸入模式中得到的元組被稱為「比較元組」。 In one embodiment of the invention, to determine the similarity of two input modes, one of the two input modes is treated as a "standard input mode" and the other is referred to as a "comparison input mode." at this time. The input mode with a small number of sampled input coordinates will be treated as the standard input mode and the other as the comparison input mode. In the embodiment of Fig. 5, the first input mode (11) is set to the comparison input mode, and the second input mode (12) is the standard input mode. Hereinafter, the tuple obtained from the standard input mode is referred to as a "standard tuple", and the tuple obtained from the comparison input mode is referred to as a "comparison tuple".

在兩個輸入模式中若已確定標準輸入模式,則從標準輸入模式中獲得的各自的標準元組以及比較輸入模式中獲得的各自的比較元組,將根據本發明一個實施例中事先設定好的「距離比較規則」進行比較。上述事先設定好的距離比較規則是為了求得構成各個元組的輸入座標之間的距離。 If the standard input mode has been determined in the two input modes, the respective standard tuple obtained from the standard input mode and the respective comparison tuple obtained in the comparison input mode will be set in advance according to an embodiment of the present invention. The "distance comparison rule" is compared. The above-described distance comparison rule is set in advance in order to find the distance between the input coordinates constituting each tuple.

圖6是用來展示圖5D中標准元組和比較元組的比較結果的。圖6中構成標準元組的輸入座標,關聯矢量以及變形矢量分別被稱為標準輸入座標,標準關聯矢量以及標準變形矢量。另外,構成比較元組的輸入座標,關聯矢量以及變形矢量分別被稱為比較輸入座標,比較關聯矢量以及比較變形矢量 Figure 6 is a graph showing the comparison results of the standard tuple and the comparison tuple in Figure 5D. The input coordinates constituting the standard tuple in Fig. 6, the correlation vector and the deformation vector are referred to as standard input coordinates, standard correlation vectors, and standard deformation vectors, respectively. In addition, the input coordinates constituting the comparison tuple, the correlation vector and the deformation vector are referred to as comparison input coordinates, respectively, and the correlation vector and the comparison deformation vector are compared.

與圖5D一起觀察,與標準元組中TR(2,2)、TR(3,3)、TR(4,4)、TR(5,5)中所屬的各個標準輸入座標R(2,2)、R(3,3)、R(4,4)、R(5,5)最靠近的是比輸入座標S(3,3)、S(6,6)、S(8,8)、S(10,10)。另外,具有這次比較輸入座標的比較元組是TS(3,3)、 TS(6,6)、TS(8,8)、TS(10,10)。 Observed together with Figure 5D, and the standard input coordinates R (2, 2) belonging to TR(2,2), TR(3,3), TR(4,4), TR(5,5) in the standard tuple. ), R(3,3), R(4,4), R(5,5) are closest to the input coordinates S(3,3), S(6,6), S(8,8), S (10, 10). In addition, the comparison tuple with this comparison input coordinate is TS(3,3), TS (6, 6), TS (8, 8), TS (10, 10).

在本發明的一個實施例中,離特定的標準元組距離最近的比較元組,可定義為具有離上述特定標準元組中所屬的標準輸入座標最鄰近的比較輸入座標的比較元組。 In one embodiment of the invention, a comparison tuple that is closest to a particular standard tuple may be defined as a comparison tuple having comparison input coordinates that are closest to the standard input coordinates to which the particular standard tuple belongs.

在本發明的一個實施例中,抽取離所有標準元組距離最近的比較元組,然後進行使其相互對應的階段,在本發明書中將其稱之為「元組匹配階段」。根據上述元組匹配階段,給出N個標準元組時,在M個的比較元組中抽取N個比較元組使其相互匹配(但,M>=N)。 In one embodiment of the present invention, the comparison tuples that are closest to all standard tuples are extracted and then phased to correspond to each other, which is referred to as the "tuple matching phase" in the present specification. According to the above-mentioned tuple matching stage, when N standard tuples are given, N comparison tuples are extracted from M comparison tuples to match each other (however, M>=N).

<為了完成模式匹配而提供的從矢量中生成代表值的方法> <Method of generating representative value from vector for completion of pattern matching>

從上述N個標準元組中生成N個成對的標準元組-比較元組,因此為標準完成根據本發明一個實施例中的模式匹配。 N pairs of standard tuple-comparison tuples are generated from the above N standard tuples, thus pattern matching in one embodiment according to the present invention is done as a standard.

在本發明的一個實施例中,上述模式匹配可以利用從標準元組以及比較元組中所屬的關聯矢量或是變數矢量中生成的代表值來完成。此時,N個標準元組可分別定義一個「標準代表值」,與各標準元組匹配的N個比較元組也可分別定義一個「比較代表值」。上述標準代表值和比較代表值可被統稱為代表值。 In one embodiment of the present invention, the pattern matching may be performed using a correlation vector generated from a standard tuple and a comparison tuple or a representative value generated in a variable vector. At this time, N standard tuples can respectively define a "standard representative value", and N comparison tuples matching each standard tuple can also define a "comparative representative value". The above-mentioned standard representative value and comparison representative value may be collectively referred to as representative values.

此時,第一個被抽樣的標準元組及比較元組,由於可以假定兩者存在於相同的位置,以此兩者不需要進行比較。因此,第一個本抽樣的標準元組(例如:TR(1,1))以及比較元組(例如:TS(1,1))也可以不定義標準代表值以及比較代表值。 At this time, the first sampled standard tuple and the comparison tuple can be assumed to exist in the same position, so that the two do not need to be compared. Therefore, the standard tuple of the first sample (for example: TR(1,1)) and the comparison tuple (for example, TS(1,1)) may also not define the standard representative value and the comparison representative value.

表4展示的是在通過圖3A中所獲得的資訊所生成的標 準元組中,被定義的標準關聯矢量的標準代表值的例子。標準關聯矢量的標準代表值用RVR(,)表示。 Table 4 shows the targets generated by the information obtained in Figure 3A. An example of a standard representative value of a standard association vector that is defined in a quasi-tuple. The standard representative value of the standard correlation vector is represented by RVR(,).

標準關聯矢量的代表值可以是標準關聯矢量其本身。另外,標準關聯矢量的代表值可以是標準關聯矢量的趨勢值。此時,標準關聯矢量其本身是上述標準關聯矢量的趨向值的特例。 The representative value of the standard association vector can be the standard association vector itself. In addition, the representative value of the standard correlation vector may be the trend value of the standard correlation vector. At this time, the standard correlation vector itself is a special case of the trend value of the above-described standard correlation vector.

上述「趨向值」是表示上述標準關聯矢量方向性的數值,特例是上述變形矢量。 The "trend value" is a numerical value indicating the directivity of the standard correlation vector, and the specific example is the above-described deformation vector.

上述趨向值可通過例如下表5中的方式來定義。 The above trend values can be defined by, for example, the manner in Table 5 below.

表5中,比如圖3B或是圖4B中出現的關聯矢量VR(j,j)以及VS(i,i)的箭頭的方向按照橫、縱分開,橫著部分的方向性被看成趨向值的第一個值,縱著部分的方向性被看成趨向值的第二個值,按此規則進行。 In Table 5, the directions of the arrows of the correlation vectors VR(j, j) and VS(i, i) appearing in FIG. 3B or FIG. 4B are separated by horizontal and vertical directions, and the directivity of the lateral portion is regarded as a trend value. The first value of the vertical portion is regarded as the second value of the trend value, and is performed according to this rule.

表6、表7及表8展示的是根據圖4A中所獲得的資訊生成的比較元組中,被定義的比較關聯矢量的比較代表值的例子。比較關聯矢量的標準代表值用RVS(,)來表示。比較關聯矢量的標準代表值的例子可給出許多,例如下表5、表6以及表7中的實例1、2、3、4等。 Tables 6, 7 and 8 show examples of comparative representative values of the comparison correlation vectors defined in the comparison tuple generated based on the information obtained in Fig. 4A. The standard representative value of the comparison correlation vector is represented by RVS(,). Examples of comparing the standard representative values of the correlation vectors can be given, for example, Examples 1, 2, 3, 4, etc. in Table 5, Table 6, and Table 7 below.

表6中的比較代表值的第一個實例可以是與標準關聯矢量匹配的比較關聯矢量其本身。 The first instance of the comparison representative value in Table 6 may be the comparison association vector that matches the standard association vector itself.

表6中出現的比較代表值的第二個實例可以是與標準關聯矢量匹配的比較關聯矢量的上述趨向值。 The second instance of the comparison representative value appearing in Table 6 may be the above-described trend value of the comparison correlation vector that matches the standard correlation vector.

表7中出現的比較代表值的第三個實例是與相關標準關聯矢量匹配的比較關聯矢量,以及其之前抽樣的比較關聯矢量組成的一個以上的比較關聯矢量的趨向值的代表值。 The third example of the comparison representative value appearing in Table 7 is a comparison correlation vector matching the correlation standard correlation vector, and a representative value of the trend value of one or more comparison correlation vectors composed of the previously compared comparison correlation vectors.

換句話說,表7中展示的比較代表值的第三個實例,是由①[與相關標準關聯矢量匹配的比較關聯矢量],以及②[與相關標準關聯矢量之前抽樣的標準關聯矢量匹配的比較關聯矢量,之後作為抽樣的比較關聯矢量,與上述相關標準關聯矢量相比配的比較關聯矢量之前抽樣的比較關聯矢量]組成的一個以上的比較關聯矢量的趨向值的代表值。 In other words, the third instance of the comparison representative value shown in Table 7 is composed of 1 [comparison correlation vector matching the correlation standard association vector], and 2 [matching the standard correlation vector sampled before the correlation standard correlation vector] The correlation vector is compared, and then the comparison correlation vector of the sample is compared with the above-described correlation standard correlation vector, and the comparison correlation vector of the comparison correlation vector before sampling is compared with the representative value of the trend value of one or more comparison correlation vectors.

表8中展示的比較代表值的第四個實例,相關標準關聯矢量相匹配的比較關聯矢量以及其之前抽樣的比較關聯矢量組成的一個以上的比較關聯矢量的趨向值全部相同時的值。與其不同,當所有值不同時上述比較代表值為(0,0)。 In the fourth example of the comparison representative value shown in Table 8, the correlation correlation vector matched by the correlation standard correlation vector and the value of the trend value of one or more comparison correlation vectors composed of the previously sampled comparison correlation vectors are all the same. In contrast, when all values are different, the above comparison represents a value of (0, 0).

表4中展示的標準代表值的實例若用於圖3A中展示的標準輸入模式,則如表9所示。 An example of the standard representative values shown in Table 4 is used in the standard input mode shown in Figure 3A, as shown in Table 9.

表6中展示的比較代表值的實例若用於圖4A中展示的比較輸入模式,則如表10所示。 An example of the comparison representative values shown in Table 6 is used in the comparison input mode shown in Figure 4A, as shown in Table 10.

表7中展示的比較代表值的實例若用於圖4A中展示的比較輸入模式,則如表11所示。 An example of the comparison representative values shown in Table 7 is used in the comparison input mode shown in Figure 4A, as shown in Table 11.

表8中展示的比較代表值的實例若用於圖4A中展示的 比較輸入模式,則如表12所示。 Examples of comparative representative values shown in Table 8 are used in the Figure 4A. Compare the input modes as shown in Table 12.

本發明一個實施例中,利用通過表4至表12說明的標準代表值和比較代表值,可測定標準輸入模式和比較輸入模式之間的相似度。大體可以利用兩種方法。 In one embodiment of the present invention, the similarity between the standard input mode and the comparison input mode can be determined using the standard representative value and the comparative representative value described by Tables 4 to 12. There are two methods that can be used in general.

方法1:只要相互匹配的標準代表值和比較代表值的差異(即,矢量間的距離)中任意一個超過事先設定好的第1臨界值(TH1)時,就可以判斷標準輸入模式和比較輸入模式不相似,反之則判斷其相似。 Method 1: As long as any one of the difference between the standard representative value and the comparison representative value (that is, the distance between the vectors) exceeds the previously set first critical value (TH1), the standard input mode and the comparison input can be judged. The patterns are not similar, otherwise they are judged to be similar.

方法2:只要相互匹配的標準代表值和比較代表值的差異(即,矢量間的距離)中任意一個超過事先設定好的第2臨界值(TH2)時,就可以判斷標準輸入模式和比較輸入模式不相似,反之則判斷其相似。 Method 2: As long as any one of the difference between the standard representative value and the comparison representative value (that is, the distance between the vectors) exceeds the previously set second threshold value (TH2), the standard input mode and the comparison input can be judged. The patterns are not similar, otherwise they are judged to be similar.

上述方法1中展示的相互匹配的標準代表值和比較代表值的差異D(),以及方法2中展示的相互匹配的標準代表值和比較代表值的差異TD都在表13中整理並展示。 The difference D() between the matching standard representative value and the comparative representative value shown in the above method 1 and the difference TD between the matching standard representative value and the comparative representative value shown in the method 2 are all sorted and shown in Table 13.

[表13] [Table 13]

表13中的值,若用於例如圖3A及圖4B中所展示的標準輸入模式和比較輸入模式時,如表14所示。 The values in Table 13 are as shown in Table 14 when used in, for example, the standard input mode and the comparison input mode shown in FIGS. 3A and 4B.

圖7圖示的是根據本發明一個實施例,執行的輸入模式間模式匹配執行方法的順序圖。 Figure 7 illustrates a sequence diagram of an inter-input mode mode matching execution method performed in accordance with one embodiment of the present invention.

本發明的一個實施例中,利用上述本發明的想法將完成下列輸入模式間輸入匹配方法。 In one embodiment of the present invention, the following input-mode input matching method is accomplished using the idea of the present invention described above.

階段(S10)中,①第1時間抽樣的標準輸入座標以及②從上述第1時間之前的第2時間抽樣的標準輸入座標中,上述第1時間獲得的標準輸入座標間的位移矢量的標準關聯矢量的值組成的N個標準元組,輸入標準輸入模式期間,準備相互不同的N個時間中獲得的N個標準元組。 In the stage (S10), the standard input coordinates of the first time sampling and the standard input coordinates of the second time sampling from the first time before the first time, the standard correlation of the displacement vectors between the standard input coordinates obtained at the first time N standard tuples composed of values of the vector, during the input of the standard input mode, prepare N standard tuples obtained in N times different from each other.

階段(S20)中,①第3時間抽樣的比較輸入座標以及②從上述第3時間之前的第4時間抽樣的比較輸入座標中,上述第3時間獲得的比較輸入座標的位移矢量的標準關聯矢量的值組成的M個比較元組,輸入比較輸入模式期間,準備相互不同的M個時間中獲得的M個比較元組。 In the stage (S20), the comparison input coordinate of the 1st time sampling and the comparison input coordinate of the 4th time sampling from the third time, the standard correlation vector of the displacement vector of the comparison input coordinate obtained at the third time The M comparison tuples composed of the values are input during the comparison input mode, and M comparison tuples obtained in M times different from each other are prepared.

階段(S30)中,根據表示上述N個標準元組的標準輸入座標,計算出M個的比較元組中所屬的比較輸入座標的距離,其中以最近距離靠近的標準元組與比較元組進行匹配。 In the stage (S30), according to the standard input coordinates indicating the N standard tuples, the distances of the comparison input coordinates belonging to the M comparison tuples are calculated, wherein the standard tuples and the comparison tuples that are closest to each other are performed. match.

階段(S40)中,以階段(S30)中相互匹配的N對標準元組和比較元組中所屬的標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的距離為基礎,判斷標準輸入模式和比較輸入模式間的相似度。 In the stage (S40), the criterion is determined based on the distance between the standard representative value of the standard paired tuple and the comparison representative value of the standard paired vector in the pair of standard tuples and the comparison tuple in the phase (S30). The similarity between the input mode and the comparison input mode.

上述階段(S40)中,包含上述匹配的N對標準元組和比較元組中所屬的標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的距離,若至少有一段距離超過事先設定的第1臨界值,可以判斷上述標準輸入模式和上述比較輸入模式並不相似的 階段(S41)。 In the above stage (S40), the distance between the standard representative value of the standard paired tuple belonging to the matched N-pair standard tuple and the comparison tuple and the comparison representative value of the comparison-related vector is included, if at least one distance exceeds the preset The first critical value, it can be judged that the above standard input mode is not similar to the above comparative input mode. Stage (S41).

另外,上述階段(S40)中,包含上述匹配的N對標準元組和比較元組中所屬的標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的N個距離的代表值(ex:平均值),若超事先設定的第2臨界值,可以判斷上述標準輸入模式和上述比較輸入模式並不相似的階段(S42)。 Further, in the above stage (S40), a representative value of the N distances between the standard representative value of the standard paired tuple belonging to the matched N-pair standard tuple and the comparison tuple and the comparison representative value of the comparison-related vector (ex) : Average value) If the second threshold value set in advance is exceeded, it is possible to determine a phase in which the standard input mode and the comparison input mode are not similar (S42).

利用上述本發明的實施例,本發明所屬技術領域的從業者,在不脫離本發明本質特點的範圍內,可以對本發明進行不同的變更及修改,並能夠輕鬆實施。申請專利範圍的各請求項的內容通過本說明書在能夠理解的範圍內,可與其他沒有引用關係的請求項結合。 The present invention can be variously modified and modified, and can be easily implemented without departing from the spirit and scope of the invention. The contents of each request item of the patent application scope can be combined with other request items having no reference relationship within the scope of the present specification.

11‧‧‧慢速輸入模式(標準輸入模式) 11‧‧‧Slow input mode (standard input mode)

12‧‧‧快速輸入模式(比較輸入模式) 12‧‧‧Quick input mode (comparison input mode)

100‧‧‧使用者電器 100‧‧‧User appliances

R(1,1)、R(2,2)、R(3,3)、R(4,4)、R(5,5)‧‧‧輸入座標(標準輸入座標) R(1,1), R(2,2), R(3,3), R(4,4), R(5,5)‧‧‧ input coordinates (standard input coordinates)

S(1,1)、S(2,2)、S(3,3)、S(4,4)、S(5,5)、S(6,6)、S(7,7)、S(8,8)、S(9,9)、S(10,10)‧‧‧輸入座標(比較輸入座標) S(1,1), S(2,2), S(3,3), S(4,4), S(5,5), S(6,6), S(7,7),S (8,8), S(9,9), S(10,10)‧‧‧ Input coordinates (comparison input coordinates)

Claims (13)

一種模式匹配方法,包括:在標準輸入模式中,作為抽樣的N個標準元組,分別包含標準輸入座標和標準關聯矢量,準備N個標準元組的階段;在比較輸入模式中,作為抽樣的M個比較元組,分別包含比較輸入座標和比較關聯矢量,準備M個比較元組的階段,其中M>=N;推測所述M個的比較元組中與所述N個的標準元組匹配的N個比較元組的階段;根據相互匹配的標準元組和比較元組對分別計算出標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的距離的階段;以及利用所述N個的標準元組和所述N個的比較元組獲得的N個的所述距離,利用所述距離中至少一段距離來確定所述標準輸入模式和所述比較輸入模式間的相似度的階段;其中所述比較代表值是所述比較關聯矢量以及所述比較關聯矢量被抽樣前被抽樣的、一個以上的其他比較關聯矢量的代表值。 A pattern matching method includes: in a standard input mode, as a sample of N standard tuples, respectively comprising a standard input coordinate and a standard correlation vector, preparing a phase of N standard tuples; in the comparison input mode, as a sampling M comparison tuples, respectively comprising a comparison input coordinate and a comparison correlation vector, preparing phases of M comparison tuples, where M>=N; presuming the M comparison metagroups and the N standard tuples a phase of matching N comparison tuples; a phase of calculating a standard representative value of the standard correlation vector and a distance between the comparison representative values of the comparison correlation vectors respectively according to the matched standard tuple and the comparison tuple pair; and using the said And determining the similarity between the standard input mode and the comparison input mode by using at least one of the distances of the N standard tuples and the N comparison tuples. a stage; wherein the comparison representative value is a representative value of the comparison correlation vector and one or more other comparison correlation vectors sampled before the comparison correlation vector is sampled. 如申請專利範圍第1項所述的模式匹配方法,其中所述推測階段包括:在屬於所述N個比較元組中的M個比較輸入座標中,推測出具有從屬於所述N個的標準元組中的N個標準輸入座標開始,到最近的比較輸入座標的N個比較元組的階段。 The pattern matching method of claim 1, wherein the speculating stage comprises: in a M comparison input coordinates belonging to the N comparison tuples, inferring to have a criterion subordinate to the N The N standard input coordinates in the tuple begin to the stage of the N comparison tuples of the most recent input input coordinates. 如申請專利範圍第1項所述的模式匹配方法,其中 所述標準代表值是矢量,表示的是所述標準關聯矢量的上下左右方向趨向值;所述比較代表值也是矢量,表示的是所述比較關聯矢量的上下左右方向的趨向值。 A pattern matching method as described in claim 1, wherein The standard representative value is a vector indicating the up, down, left, and right direction trend values of the standard correlation vector; the comparison representative value is also a vector, and represents a trend value of the upper and lower directions of the comparison related vector. 如申請專利範圍第3項所述的模式匹配方法,其中所述標準關聯矢量的上下左右方向的趨向值就是所述標準關聯矢量,所述比較關聯矢量的上下左右方向的趨向值可以是所述比較關聯矢量。 The pattern matching method according to claim 3, wherein the trend value of the up, down, left, and right directions of the standard correlation vector is the standard correlation vector, and the trend value of the up, down, left, and right directions of the comparison associative vector may be Compare the associated vectors. 如申請專利範圍第1項所述的模式匹配方法,其中所述確定相似度的階段包括一個階段,即:所述獲得的N個的距離中,若至少有一段距離超過事先設定的第1臨界值,就可以判斷所述標準輸入模式和所述比較輸入模式並不相似。 The mode matching method according to claim 1, wherein the phase of determining the similarity includes a phase, that is, if at least one of the obtained N distances exceeds a first threshold set in advance Value, it can be judged that the standard input mode and the comparison input mode are not similar. 如申請專利範圍第1項所述的模式匹配方法,其中所述確定相似度的階段,包括一個階段,即:所述獲得的N個的距離的代表值若超過事先設定的第2臨界值,就可以判斷所述標準輸入模式和所述比較輸入模式並不相似。 The mode matching method according to claim 1, wherein the phase of determining the similarity includes a phase, that is, if the representative value of the obtained N distances exceeds a second threshold value set in advance, It can be judged that the standard input mode and the comparison input mode are not similar. 如申請專利範圍第1項所述的模式匹配方法,其中所述模式匹配方法中所包含的各個階段,對觸摸屏設備中輸入的模擬信號進行處理,確定觸摸輸入位置;將所述確定的觸摸輸入位置的相關資訊傳遞到其他處理設備這些階段可在觸摸積體電路中被完成。 The pattern matching method according to claim 1, wherein each stage included in the pattern matching method processes an analog signal input in the touch screen device to determine a touch input position; and the determined touch input The transfer of location related information to other processing devices can be done in the touch integrated circuit. 如申請專利範圍第7項所述的模式匹配方法,其中 所述觸摸積體電路具有以第1處理器速度進行操作的第1模式,以及以比所述第1處理器速度快的第2處理器速度進行操作的第2模式,所述模式匹配方法中包含的各個階段可以在所述第1模式下執行。 A pattern matching method as described in claim 7 of the patent application, wherein The touch integrated circuit includes a first mode that operates at a first processor speed and a second mode that operates at a second processor speed that is faster than the first processor speed, in the pattern matching method The various stages involved can be performed in the first mode. 如申請專利範圍第1項所述的模式匹配方法,其中在所述標準輸入模式以及所述比較輸入模式中,其中一個是根據使用者在第1時間輸入後被事先儲存的模式,另一個是在所述第1時間後的第2時間被輸入的輸入模式。 The pattern matching method according to claim 1, wherein in the standard input mode and the comparison input mode, one of them is a mode that is stored in advance according to a user input at the first time, and the other is The input mode that is input at the second time after the first time. 一種觸摸積體電路,用以作為對觸摸屏設備中輸入的模擬信號進行處理,確定觸摸輸入位置,並且將所述確定的觸摸輸入位置的相關資訊傳遞到其他處理設備,所述觸摸積體電路包含的處理器用以執行下列步驟:作為抽樣的N個標準元組,分別包含標準輸入座標和標準關聯矢量,準備N個標準元組的階段;在比較輸入模式中,作為抽樣的M個比較元組,分別包含比較輸入座標和比較關聯矢量,準備M個比較元組的階段,其中M>=N;推測所述M個的比較元組中與所述N個的標準元組匹配的N個比較元組的階段;根據相互匹配的標準元組和比較元組對分別計算出標準關聯矢量的標準代表值和比較關聯矢量的比較代表值間的距離的階段;以及利用所述N個的標準元組和所述N個的比較元組獲得的N個 的所述距離,並利用其中至少一段距離來確定所述標準輸入模式和所述比較輸入模式間的相似度的階段;其中所述比較代表值是所述比較關聯矢量以及所述比較關聯矢量被抽樣前被抽樣的、一個以上的其他比較關聯矢量的代表值。 A touch integrated circuit for processing an analog signal input in a touch screen device, determining a touch input position, and transmitting related information of the determined touch input position to another processing device, wherein the touch integrated circuit includes The processor is configured to perform the following steps: as a sample of N standard tuples, including standard input coordinates and standard correlation vectors, respectively, to prepare N standard tuple stages; in the comparison input mode, as comparison M groups of samples , respectively, including comparing the input coordinates and comparing the correlation vectors, preparing M comparison tuple stages, where M>=N; presuming N comparisons of the M comparison tuples matching the N standard tuples a stage of the tuple; a stage of calculating a standard representative value of the standard correlation vector and a distance between the comparison representative values of the comparison correlation vector according to the matched standard tuple and the comparison tuple pair; and using the N standard elements N obtained by the group and the N comparison tuples And the phase of determining the degree of similarity between the standard input mode and the comparison input mode using at least one of the distances; wherein the comparison representative value is the comparison correlation vector and the comparison correlation vector is A representative value of one or more other comparison correlation vectors sampled before sampling. 一種觸摸積體電路,用以作為對觸摸屏設備中輸入的模擬信號進行處理,確定觸摸輸入位置,並且將所述確定的觸摸輸入位置的相關資訊傳遞到其他處理設備,所述觸摸積體電路更用以執行:作為在第1輸入模式中抽樣的N個的第1資訊,分別包含了第1座標和第1矢量的N個第1資訊的準備階段;作為在第2輸入模式中抽樣的M個的第2資訊,分別包含了第2座標和第2矢量的M個第2資訊的準備階段,其中M>=N;推測出所述M個第2資訊中與所述N個的第1資訊匹配的N個第2資訊的階段;根據相互匹配的第1資訊和第2資訊對分別計算出第1矢量的第1代表值和第2矢量的第2代表值之間的距離的階段;以及利用所述N個的第1資訊和所述N個的第2資訊獲得的N個的所述距離,並利用其中至少一段距離來確定所述第1輸入模式和所述第2輸入模式之間的相似度的階段;其中所述第2代表值是所述第2矢量以及所述第2矢量被抽樣前被抽樣的、一個以上的其他第2矢量的代表值。 A touch integrated circuit for processing an analog signal input in a touch screen device, determining a touch input position, and transmitting related information of the determined touch input position to other processing devices, wherein the touch integrated circuit further For performing, the N pieces of first information sampled in the first input mode include preparation stages of N pieces of first information of the first coordinate and the first vector, and Ms sampled in the second input mode. The second information includes the preparation stages of the M second information of the second coordinate and the second vector, where M>=N; and the first of the M second information and the N first a stage of N pieces of second information matching the information; and a stage of calculating a distance between the first representative value of the first vector and the second representative value of the second vector based on the first information and the second information pair that match each other; And determining the first input mode and the second input mode by using at least one of the N distances obtained by using the N first information and the N second information. Phase of similarity; wherein the second representative value The vector and the second vector is prior to said second samples are sampled, a representative value other than the second vector. 一種模式匹配方法,包括:在第1輸入模式中,推測出一個以上的抽樣第1座標間的第1 位移矢量的第1推測階段;在第2輸入模式中,推測出一個以上的抽樣第2座標間的第2位移矢量的第2推測階段;所述第1位移矢量和所述第2位移矢量按照事先設定的規則相互匹配的階段;所述匹配完成的第1位移矢量和所述第2位移矢量的第1代表值和所述第2位移矢量的第2代表值間的距離,以此距離為基礎判斷出所述第1輸入模式和所述第2輸入模式間的相似度的階段;其中所述第1位移矢量的個數比所述第2位移矢量的個數少,所述第1位移矢量至少一個與所述第2位移矢量中的複數個匹配。 A pattern matching method includes: estimating, in the first input mode, the first of the first coordinates of one or more samples a first estimation phase of the displacement vector; in the second input mode, a second estimation phase of the second displacement vector between the second coordinates of one or more samples is estimated; the first displacement vector and the second displacement vector are in accordance with a stage in which the rules set in advance match each other; a distance between the first displacement vector of the matching and the first representative value of the second displacement vector and the second representative value of the second displacement vector; a stage of determining a similarity between the first input mode and the second input mode; wherein the number of the first displacement vectors is smaller than the number of the second displacement vectors, and the first displacement At least one of the vectors matches a plurality of the second displacement vectors. 如申請專利範圍第12項所述的模式匹配方法,其中所述第1位移矢量及所述第2位移矢量可表現出抽樣時間在時間軸上相互臨近的一對座標間的位移。 The pattern matching method according to claim 12, wherein the first displacement vector and the second displacement vector represent displacements between a pair of coordinates whose sampling times are adjacent to each other on a time axis.
TW104115141A 2014-05-14 2015-05-13 Pattern matching method and touch integrated circuit TWI552025B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140057566A KR20150130687A (en) 2014-05-14 2014-05-14 Method for recognizing user gesture using vector-based pattern matching

Publications (2)

Publication Number Publication Date
TW201606577A TW201606577A (en) 2016-02-16
TWI552025B true TWI552025B (en) 2016-10-01

Family

ID=54480229

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104115141A TWI552025B (en) 2014-05-14 2015-05-13 Pattern matching method and touch integrated circuit

Country Status (3)

Country Link
KR (1) KR20150130687A (en)
TW (1) TWI552025B (en)
WO (1) WO2015174750A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101860319B1 (en) * 2016-11-02 2018-05-23 충남대학교산학협력단 Authentication method using user's keyboard and mouse input behavior pattern and storing medium storing authentication program using the method thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002196878A (en) * 2000-12-27 2002-07-12 Celsys:Kk Recording medium, picture processor and its method
CN101248410A (en) * 2005-08-22 2008-08-20 三星电子株式会社 Device and method for recognizing movement mode
TW201118661A (en) * 2009-11-27 2011-06-01 Kye Systems Corp Track input device and processing method thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0895697A (en) * 1994-09-26 1996-04-12 Oki Electric Ind Co Ltd Writing pen, writing information processing method and acceleration detector
US7809214B2 (en) * 2005-08-22 2010-10-05 Samsung Electronics Co., Ltd. Device and a method for identifying movement patterns
KR20130015659A (en) * 2011-08-04 2013-02-14 주식회사 드림켓 Apparatus equipped with touchscreen and control method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002196878A (en) * 2000-12-27 2002-07-12 Celsys:Kk Recording medium, picture processor and its method
CN101248410A (en) * 2005-08-22 2008-08-20 三星电子株式会社 Device and method for recognizing movement mode
TW201118661A (en) * 2009-11-27 2011-06-01 Kye Systems Corp Track input device and processing method thereof

Also Published As

Publication number Publication date
TW201606577A (en) 2016-02-16
KR20150130687A (en) 2015-11-24
WO2015174750A1 (en) 2015-11-19

Similar Documents

Publication Publication Date Title
TWI579734B (en) 3d visualization
KR102424803B1 (en) Touch classification
US20200097091A1 (en) Method and Apparatus of Interactive Display Based on Gesture Recognition
RU2014108820A (en) IMAGE PROCESSOR CONTAINING A SYSTEM FOR RECOGNITION OF GESTURES WITH FUNCTIONAL FEATURES FOR DETECTING AND TRACKING FINGERS
US20110299737A1 (en) Vision-based hand movement recognition system and method thereof
Wen et al. A robust method of detecting hand gestures using depth sensors
US10671841B2 (en) Attribute state classification
US20130069867A1 (en) Information processing apparatus and method and program
KR101745651B1 (en) System and method for recognizing hand gesture
KR101559502B1 (en) Method and recording medium for contactless input interface with real-time hand pose recognition
Xu et al. A novel feature extracting method for dynamic gesture recognition based on support vector machine
CN108521820B (en) Coarse to fine hand detection method using deep neural network
US20160093055A1 (en) Information processing apparatus, method for controlling same, and storage medium
TWI552025B (en) Pattern matching method and touch integrated circuit
US9727145B2 (en) Detecting device and detecting method
US10304258B2 (en) Human feedback in 3D model fitting
Rodriguez et al. Robust vision-based hand tracking using single camera for ubiquitous 3D gesture interaction
CN104951135B (en) A kind of information processing unit and method
JP2018116397A (en) Image processing device, image processing system, image processing program, and image processing method
Lin et al. Projection-based user interface for smart home environments
Shim et al. Interactive features based augmented reality authoring tool
JP6289655B2 (en) Screen operation apparatus and screen operation method
Choi et al. A study on providing natural two-handed interaction using a hybrid camera
Huang et al. P. 131: A Significant Multi‐Touch Algorithm for the Tracking Problem Based on the Hungarian Algorithm
KR20120071230A (en) Method of tracking fingertips in augmented reality environment