TWI633278B - Three-dimensional space touch panel detection system and method - Google Patents

Three-dimensional space touch panel detection system and method Download PDF

Info

Publication number
TWI633278B
TWI633278B TW106119883A TW106119883A TWI633278B TW I633278 B TWI633278 B TW I633278B TW 106119883 A TW106119883 A TW 106119883A TW 106119883 A TW106119883 A TW 106119883A TW I633278 B TWI633278 B TW I633278B
Authority
TW
Taiwan
Prior art keywords
axis
image
touch
rotation mechanism
circle
Prior art date
Application number
TW106119883A
Other languages
Chinese (zh)
Other versions
TW201905418A (en
Inventor
李昆益
苗延浩
鄧仲豪
王致惟
廖子騰
周巧慧
李政彥
楊政儒
李偉裕
Original Assignee
中華學校財團法人中華科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中華學校財團法人中華科技大學 filed Critical 中華學校財團法人中華科技大學
Priority to TW106119883A priority Critical patent/TWI633278B/en
Application granted granted Critical
Publication of TWI633278B publication Critical patent/TWI633278B/en
Publication of TW201905418A publication Critical patent/TW201905418A/en

Links

Abstract

本發明揭露一種三維空間觸控面板檢測系統及其方法,其包括三軸移動平台、多軸旋轉機構、測試觸控桿、光源、影像擷取裝置及控制模組。多軸旋轉機構設於三軸移動平台之第三驅動機構。測試觸控桿可隨多軸旋轉機構位移旋轉而對待測面板進行觸控檢測。光源設於多軸旋轉機構靠上,用以朝向待測面板投射光源。影像擷取裝置用以擷取待測面板反射光源的光點影像。控制模組依據預設路徑控制三軸移動平台做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿與觸控面的接觸點之法線為同一軸線,俾能降低生產成本及簡化測試標準路徑,以達到最佳曲面量測檢測設備水準。 The invention discloses a three-dimensional space touch panel detection system and method, which includes a three-axis mobile platform, a multi-axis rotation mechanism, a test touch lever, a light source, an image capture device, and a control module. The multi-axis rotating mechanism is provided on the third driving mechanism of the three-axis moving platform. The test touch lever can perform touch detection on the panel under test with the rotation of the multi-axis rotation mechanism. The light source is arranged above the multi-axis rotation mechanism and is used to project the light source toward the panel to be tested. The image capturing device is used to capture the light spot image of the reflective light source of the panel under test. The control module controls the three-axis mobile platform to make the corresponding displacement according to the preset path, and then performs image processing and true circle arithmetic operation on the light spot image, and controls the multi-axis rotating mechanism to make the corresponding uniaxial axis according to the calculation result Or the two axial rotations are used to make the normal of the contact point of the test touch lever and the touch surface the same axis, so as to reduce the production cost and simplify the test standard path, so as to achieve the best surface measurement and inspection equipment level.

Description

三維空間觸控面板檢測系統及其方法 Three-dimensional space touch panel detection system and method

本發明係有關一種三維空間觸控面板檢測系統及其方法,尤指一種可以降低生產成本及簡化測試標準路徑而達到最佳曲面量測檢測設備水準的觸控面板檢測技術。 The invention relates to a three-dimensional space touch panel detection system and method, in particular to a touch panel detection technology that can reduce production costs and simplify test standard paths to achieve the best curved surface measurement and detection equipment level.

根據日經新聞報導,住友化學(Sumitomo Chemical)將增產搭載OLED面板智慧手機用曲面觸控面板產品,目標在2018年初將曲面觸控面板產能擴增至每年1億支手機需求。主因在於,近年來,三星、蘋果(Apple)、等國際大廠之手機、平板、電腦、多媒體電視逐漸邁向曲面面板設計,目前工廠製造生產時所使用之檢測設備大多為檢測平面式觸控面板的裝置,並無專屬之三維曲面觸控面板的檢測裝置。 According to a Nikkei news report, Sumitomo Chemical will increase the production of curved touch panel products for smartphones equipped with OLED panels. It aims to expand the capacity of curved touch panels to 100 million mobile phones per year in early 2018. The main reason is that in recent years, mobile phones, tablets, computers, and multimedia TVs of Samsung, Apple, and other international manufacturers have gradually moved toward curved panel design. At present, most of the testing equipment used in factory production and production are flat touch detection. The panel device does not have a dedicated three-dimensional curved touch panel detection device.

雖有少數廠商開發出曲面觸控面板檢測裝置,但是此種曲面觸控面板檢測裝置大多是以機械手臂來檢測處理3D曲面觸控面板,雖然機械手臂可以用來檢測3D曲面的觸控面板;惟,應用機械手臂檢測處理3D曲面觸控面板檢測設備的成本過高,以致影響廠商裝設的意願,致使機械手臂無法普及成為檢測曲面觸控面板的必要檢測裝置;不僅如此,所需的位移路徑控制,就會讓工程師的學習曲線拉長,以致大幅增加人力與時間的耗費成本,因而造成曲面觸控面板檢測上的不便與極大的困擾情事產生。 Although a few manufacturers have developed curved touch panel detection devices, most of these curved touch panel detection devices use mechanical arms to detect and process 3D curved touch panels, although robotic arms can be used to detect 3D curved touch panels; However, the cost of applying a robotic arm to process 3D curved touch panel inspection equipment is too high, which affects the manufacturer's willingness to install, so that the robotic arm cannot be popularized as a necessary inspection device for detecting curved touch panel; not only that, the required displacement Path control will lengthen the learning curve of engineers, which will greatly increase the cost of manpower and time, thus causing inconvenience and great troubles in the detection of curved touch panels.

有鑒於此,平面式觸控面板檢測設備已行之有年,產品技術之成熟度未臻完善,仍有再改善的必要性,因此,如何開發出一套可以自主追尋曲面而達到觸控檢測目的及簡化產生測試標準路徑的觸控面板檢測技術實已成為相關產學業者所亟需挑戰與克服的技術課題。 In view of this, the planar touch panel inspection equipment has been in operation for many years, the maturity of the product technology has not been perfected, and there is still a need for further improvement. Therefore, how to develop a set that can independently pursue the curved surface to achieve touch inspection Purpose and simplification of touch panel inspection technology for generating test standard paths has become a technical issue that is urgently needed to be challenged and overcome by relevant industry and academics.

本發明所欲解決的技術課題在於,解決目前應用機械手臂檢測處理3D曲面觸控面板檢測成本高以及工程師學習曲線過長的問題。 The technical problem to be solved by the present invention is to solve the problems of high detection cost of the 3D curved touch panel currently detected by the mechanical arm detection processing and the long learning curve of the engineer.

本發明第一目的在於提供一種三維空間觸控面板檢測系統及其方法,主要是以平面觸控面板檢測裝置為基礎架構,並在平面觸控面板檢測裝置之Z軸裝設自主追尋曲面垂直距離的控制機制,除了可以實現自主追尋曲面而達到曲面觸控檢測之目的之外,並可降低生產成本及簡化產生測試標準路徑,進而達到最佳曲面量測檢測設備水準。達成本發第一明目及解決問題的技術手段,係包括三軸移動平台、多軸旋轉機構、測試觸控桿、光源、影像擷取裝置及控制模組。多軸旋轉機構設於三軸移動平台之第三驅動機構。測試觸控桿可隨多軸旋轉機構位移旋轉而對待測面板進行觸控檢測。光源設於多軸旋轉機構靠上,用以朝向待測面板投射光源。影像擷取裝置用以擷取待測面板反射光源的光點影像。控制模組依據預設路徑控制三軸移動平台做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿與觸控面的接觸點之法線為同一軸線或是處於接近該軸線的角度。 The first object of the present invention is to provide a three-dimensional space touch panel detection system and method, which is mainly based on a planar touch panel detection device, and is equipped with an independent tracking surface vertical distance on the Z axis of the planar touch panel detection device In addition to the control mechanism that can realize the independent tracking of the surface to achieve the purpose of surface touch detection, it can also reduce production costs and simplify the production of standard test paths, thereby achieving the best level of surface measurement and testing equipment. The technical means to achieve the first goal and solve the problem include three-axis mobile platform, multi-axis rotation mechanism, test touch lever, light source, image capture device and control module. The multi-axis rotating mechanism is provided on the third driving mechanism of the three-axis moving platform. The test touch lever can perform touch detection on the panel under test with the rotation of the multi-axis rotation mechanism. The light source is arranged above the multi-axis rotation mechanism and is used to project the light source toward the panel to be tested. The image capturing device is used to capture the light spot image of the reflective light source of the panel under test. The control module controls the three-axis mobile platform to make the corresponding displacement according to the preset path, and then performs image processing and true circle arithmetic operation on the light spot image, and controls the multi-axis rotating mechanism to make the corresponding uniaxial axis according to the calculation result Or two axial rotations, so that the normal of the contact point of the test touch lever and the touch surface is the same axis or at an angle close to the axis.

本發明第二目的在於提供一種可以有效縮短檢測時間的三 維空間觸控面板檢測系統及其方法,在不需製作曲面3D預設路徑資料的情況下,僅以2D預設路徑資料之運作即可檢測3D曲面的待測面板,進而達到有效縮短檢測時間的功效。達成本發第二明目的採用之技術手段,係包括三軸移動平台、多軸旋轉機構、測試觸控桿、光源、影像擷取裝置及控制模組。多軸旋轉機構設於三軸移動平台之第三驅動機構。測試觸控桿可隨多軸旋轉機構位移旋轉而對待測面板進行觸控檢測。光源設於多軸旋轉機構靠上,用以朝向待測面板投射光源。影像擷取裝置用以擷取待測面板反射光源的光點影像。控制模組依據預設路徑控制三軸移動平台做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿與觸控面的接觸點之法線為同一軸線或是處於接近該軸線的角度。其中,本實施例主要在於,上述預設路徑係為2D平面的路徑資料。 The second object of the present invention is to provide a method which can effectively shorten the detection time. A three-dimensional space touch panel detection system and method thereof, without the need to create curved 3D preset path data, only the operation of 2D preset path data can detect the 3D curved surface to be tested, thereby effectively shortening the detection time Effect. The technical means adopted to achieve the second most obvious objective include three-axis mobile platform, multi-axis rotation mechanism, test touch lever, light source, image capture device and control module. The multi-axis rotating mechanism is provided on the third driving mechanism of the three-axis moving platform. The test touch lever can perform touch detection on the panel under test with the rotation of the multi-axis rotation mechanism. The light source is arranged above the multi-axis rotation mechanism and is used to project the light source toward the panel to be tested. The image capturing device is used to capture the light spot image of the reflective light source of the panel under test. The control module controls the three-axis mobile platform to make the corresponding displacement according to the preset path, and then performs image processing and true circle arithmetic operation on the light spot image, and controls the multi-axis rotating mechanism to make the corresponding uniaxial axis according to the calculation result Or two axial rotations, so that the normal of the contact point of the test touch lever and the touch surface is the same axis or at an angle close to the axis. Wherein, this embodiment mainly lies in that the above-mentioned predetermined path is the path data of the 2D plane.

10‧‧‧三軸移動平台 10‧‧‧Three axis mobile platform

11‧‧‧第一驅動機構 11‧‧‧ First driving mechanism

12‧‧‧第二驅動機構 12‧‧‧ Second drive mechanism

13‧‧‧第三驅動機構 13‧‧‧ Third drive mechanism

20‧‧‧多軸旋轉機構 20‧‧‧Multi-axis rotating mechanism

21‧‧‧水平旋轉機構 21‧‧‧horizontal rotating mechanism

22‧‧‧縱向旋轉機構 22‧‧‧Longitudinal rotation mechanism

30‧‧‧測試觸控桿 30‧‧‧Test Touch Bar

40‧‧‧光源 40‧‧‧Light source

41‧‧‧影像擷取裝置 41‧‧‧Image capture device

鏡頭 Lens

50‧‧‧控制模組 50‧‧‧Control module

60‧‧‧待測面板 60‧‧‧ Panel to be tested

61‧‧‧觸控面 61‧‧‧Touch surface

圖1係本發明功能方塊的實施示意圖。 FIG. 1 is a schematic diagram of the implementation of the functional blocks of the present invention.

圖2係本發明具體架構實施的外觀示意圖。 FIG. 2 is a schematic view of the implementation of the specific architecture of the present invention.

圖3係本發明多軸旋轉機構的具體實施示意圖。 FIG. 3 is a schematic diagram of a specific implementation of the multi-axis rotation mechanism of the present invention.

圖4係本發明測試觸控桿測試不同形狀觸控面的實施示意圖。 FIG. 4 is a schematic diagram of an embodiment of the present invention for testing touch bars to test touch surfaces with different shapes.

圖5係本發明觸控面的法線分佈的實施示意圖。 5 is a schematic diagram of the normal distribution of the touch surface of the present invention.

圖6係本發明真正圓運算法的運算實施示意圖。 FIG. 6 is a schematic diagram of the operation of the real circle calculation method of the present invention.

圖7係本發明影像處理及真正圓運算法的流程控制實施示意圖。 7 is a schematic diagram of the flow control implementation of the image processing and true circle arithmetic method of the present invention.

圖8係本發明第一實驗例的影像對照實施示意圖。 FIG. 8 is a schematic diagram of an image comparison implementation of the first experimental example of the present invention.

圖9係本發明第二實驗例的影像對照實施示意圖。 9 is a schematic diagram of an image comparison implementation of a second experimental example of the present invention.

圖10係本發明第三實驗例的影像對照實施示意圖。 FIG. 10 is a schematic diagram of an image comparison implementation of a third experimental example of the present invention.

圖11係本發明第四實驗例的影像對照實施示意圖。 FIG. 11 is a schematic diagram of an image comparison implementation of a fourth experimental example of the present invention.

圖12係本發明第五實驗例的影像對照實施示意圖。 FIG. 12 is a schematic diagram of an image comparison implementation of a fifth experimental example of the present invention.

圖13係本發明第六實驗例的影像對照實施示意圖。 FIG. 13 is a schematic diagram of an image comparison implementation of a sixth experimental example of the present invention.

為讓 貴審查委員能進一步瞭解本發明整體的技術特徵與達成本發明目的之技術手段,玆以具體實施例並配合圖式加以詳細說明如下:請配合參看圖1~5所示為達成本發明第一目的之具體實施例,係包括三軸移動平台10、多軸旋轉機構20、測試觸控桿30、光源40、影像擷取裝置41及控制模組50等技術特徵。多軸旋轉機構20設於三軸移動平台10之第三驅動機構13。三軸移動平台10可供放置至少一待測面板60,該三軸移動平台10包含可分別往三個不同軸向位移的一第一驅動機構11(即往X軸向位移)、一第二驅動機構12(即往Y軸向位移)及一第三驅動機構13(即往Z軸向位移)。多軸旋轉機構20設於第三驅動機構13上,用以做出至少二種軸向(即水平向與縱向』的旋轉。測試觸控桿30(即測試銅頭)設於多軸旋轉機構20,可隨著多軸旋轉機構20位移及旋轉,以對待測面板60進行觸控檢測。光源40(如發光二極體LED;或是雷射)其設於多軸旋轉機構20靠近測試觸控桿30的位置上,用以朝向待測面板60之觸控面61投射光源。影像擷取裝置41設於多軸旋轉機構20靠近光源40的位置上,用以擷取自待測面板60所反射光源的光點影像。控制模組50內建有至少一預設路徑,並依據此預設路徑控制三軸移動平台10做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構20做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿30 之軸線與觸控面61接觸點的法線為同一軸線;或是接近同一軸線;換言之,該軸線與該法線重合,或是接近重合的狀態。至於『接近同一軸線』與『接近重合的狀態』是指測試觸控桿30之該軸線與接觸點的該法線的夾角小於3度而言。 In order for your reviewer to further understand the overall technical features of the present invention and the technical means for achieving the purpose of the invention, the specific embodiments and drawings are used to explain in detail as follows: Please refer to Figures 1 to 5 for the invention The specific embodiment of the first object includes technical features such as a three-axis mobile platform 10, a multi-axis rotation mechanism 20, a test touch lever 30, a light source 40, an image capture device 41, and a control module 50. The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 of the three-axis moving platform 10. The three-axis mobile platform 10 can accommodate at least one panel under test 60. The three-axis mobile platform 10 includes a first driving mechanism 11 (that is, an X-axis displacement) that can be displaced to three different axial directions, and a second The driving mechanism 12 (that is, the displacement toward the Y axis) and a third driving mechanism 13 (that is, the displacement toward the Z axis). The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 to make at least two kinds of axial (namely horizontal and vertical) rotations. The test touch lever 30 (ie testing the copper head) is provided on the multi-axis rotating mechanism 20. The multi-axis rotation mechanism 20 can be displaced and rotated to perform touch detection on the test panel 60. A light source 40 (such as a light-emitting diode LED; or a laser) is disposed on the multi-axis rotation mechanism 20 near the test touch The position of the lever 30 is used to project the light source toward the touch surface 61 of the panel under test 60. The image capturing device 41 is provided at a position of the multi-axis rotation mechanism 20 close to the light source 40 for capturing from the panel under test 60 The light spot image of the reflected light source. The control module 50 has at least one preset path built in, and controls the three-axis mobile platform 10 to make a corresponding displacement according to the preset path, and then performs image processing and true circle on the light spot image The calculation of the arithmetic method, and according to the calculation result, the multi-axis rotating mechanism 20 is controlled to make corresponding single-axis or two-axis rotation to test the touch lever 30 The axis of the touch point and the normal of the touch point 61 are the same axis; or close to the same axis; in other words, the axis coincides with the normal, or is close to the state of coincidence. As for "near the same axis" and "nearly coincident state", it means that the angle between the axis of the touch lever 30 and the normal of the contact point is less than 3 degrees.

請配合參看圖3所示的實施例中,該影像擷取裝置41與光源40位於測試觸控桿30的上方附近的位置上。具體的,上述多軸旋轉機構20包含一可往水平向轉動的水平旋轉機構21,一可往縱向轉動的縱向旋轉機構22。水平旋轉機構21設於第三驅動機構13的致動桿130末端上。縱向旋轉機構22設於水平旋轉機構21底部,影像擷取裝置41與光源40設於縱向旋轉機構22上。 Please refer to the embodiment shown in FIG. 3, the image capturing device 41 and the light source 40 are located near the top of the test touch lever 30. Specifically, the multi-axis rotation mechanism 20 includes a horizontal rotation mechanism 21 that can rotate horizontally, and a vertical rotation mechanism 22 that can rotate vertically. The horizontal rotation mechanism 21 is provided on the end of the actuation lever 130 of the third drive mechanism 13. The vertical rotation mechanism 22 is provided at the bottom of the horizontal rotation mechanism 21, and the image capturing device 41 and the light source 40 are provided on the vertical rotation mechanism 22.

請配合參看圖1~5所示為達成本發明第二目的之具體實施例,係包括三軸移動平台10、多軸旋轉機構20、測試觸控桿30、光源40、影像擷取裝置41及控制模組50等技術特徵。多軸旋轉機構20設於三軸移動平台10之第三驅動機構13。三軸移動平台10可供放置至少一待測面板60,該三軸移動平台10包含可分別往三個不同軸向位移的一第一驅動機構11(即往X軸向位移)、一第二驅動機構12(即往Y軸向位移)及一第三驅動機構13(即往Z軸向位移)。多軸旋轉機構20設於第三驅動機構13上,用以做出至少二種軸向(即水平向與縱向』的旋轉。測試觸控桿30(即測試銅頭)設於多軸旋轉機構20,可隨著多軸旋轉機構20位移及旋轉,以對待測面板60進行觸控檢測。光源40(如發光二極體LED;或是雷射)其設於多軸旋轉機構20靠近測試觸控桿30的位置上,用以朝向待測面板60之觸控面61投射光源。影像擷取裝置41設於多軸旋轉機構20靠近光源40的位置上,用以擷取自待測面板60所反射光源的光點影像。控制模組50內建有至少一預設路徑,並依據此預設路徑控制三軸移動平台10做出對應的位移,再對 光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構20做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿30與觸控面61的接觸點之法線為同一軸線;或是接近同一軸線,亦即,測試觸控桿30與該軸線的夾角介於0.1~3度的角度範圍。其中,本實施例主要在於,上述預設路徑係為2D平面的路徑資料,於此,即可在不需製作曲面3D預設路徑資料的情況下,僅以2D預設路徑資料之運作即可檢測3D曲面的待測面板60。 Please refer to FIGS. 1 to 5 for a specific embodiment of achieving the second object of the invention, which includes a three-axis mobile platform 10, a multi-axis rotation mechanism 20, a test touch lever 30, a light source 40, an image capture device 41 and Control module 50 and other technical features. The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 of the three-axis moving platform 10. The three-axis mobile platform 10 can accommodate at least one panel under test 60. The three-axis mobile platform 10 includes a first driving mechanism 11 (that is, an X-axis displacement) that can be displaced to three different axial directions, and a second The driving mechanism 12 (that is, the displacement toward the Y axis) and a third driving mechanism 13 (that is, the displacement toward the Z axis). The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 to make at least two kinds of axial (namely horizontal and vertical) rotations. The test touch lever 30 (ie testing the copper head) is provided on the multi-axis rotating mechanism 20. The multi-axis rotation mechanism 20 can be displaced and rotated to perform touch detection on the test panel 60. A light source 40 (such as a light-emitting diode LED; or a laser) is disposed on the multi-axis rotation mechanism 20 near the test touch The position of the lever 30 is used to project the light source toward the touch surface 61 of the panel under test 60. The image capturing device 41 is provided at a position of the multi-axis rotation mechanism 20 close to the light source 40 for capturing from the panel under test 60 The light spot image of the reflected light source. The control module 50 has at least one preset path built in, and controls the three-axis mobile platform 10 to make a corresponding displacement according to the preset path, and then The light spot image is processed by image processing and true circle arithmetic, and the multi-axis rotation mechanism 20 is controlled to make corresponding uniaxial or two-axis rotation according to the calculation result, which is used to test the touch lever 30 and touch The normal of the contact point of the control surface 61 is the same axis; or close to the same axis, that is, the angle between the test touch lever 30 and the axis is within an angle range of 0.1 to 3 degrees. Among them, this embodiment mainly lies in that the above-mentioned preset path is 2D plane path data. Here, it is possible to operate only with 2D default path data without making curved 3D default path data The 3D curved surface to be tested panel 60 is detected.

具體的,請配合參看圖7所示,上述控制模組50所做的影像處理係包含步驟一:將擷取得之彩色該光點影像轉換為灰階影像。步驟二:運用Canny演算法取得灰階之該光點影像的影像邊緣。步驟三:對該影像邊緣進行影像二值化處理。 Specifically, please refer to FIG. 7. The image processing performed by the control module 50 includes step 1: converting the captured color spot image into a grayscale image. Step 2: Use Canny algorithm to obtain the image edge of the light spot image in gray scale. Step 3: Perform image binarization on the image edge.

具體的,請配合參看圖7所示,上述控制模組50所做的真正圓運算法包含步驟一:輸入光點影像的邊點數。步驟二:邊點集中隨機選擇四個邊點。步驟三:運用克拉瑪公式理論來決定候選圓,並解出圓心與半徑,再經過圓的直軸與交軸比較確定是否為真正圓。步驟四:判斷真正圓失敗數是否小於容忍數;判斷結果為是,則回到步驟二;判斷結果為否,則進入步驟六。步驟六:移動該影像擷取裝置41之鏡頭對準圓心。 Specifically, please refer to FIG. 7. The real circle calculation method performed by the control module 50 includes step 1: inputting the number of edge points of the light spot image. Step 2: Randomly select four edge points. Step 3: Use the theory of Klama formula to determine the candidate circle, solve the center and radius of the circle, and then compare the straight axis and the intersection axis of the circle to determine whether it is a true circle. Step 4: Determine whether the true circle failure number is less than the tolerance number; if the judgment result is yes, return to step two; if the judgment result is no, go to step six. Step 6: Move the lens of the image capturing device 41 to the center of the circle.

本發明系統結構在於建立一種三維空間控制之自主追尋曲面垂直距離的控制模組50(如微控制器;或電腦與軟體的組合),其中在X,Y,Z移動平台上將Z軸交由自主追尋曲面垂直距離之控制模組50掌控,Z軸軸架上加裝二組活動A軸與B軸,於活動A軸上架設一具有攝影鏡頭的影像擷取裝置41,鏡頭上方與Z軸同軸線處架設雷射或是LED於鏡頭前成相,由鏡頭擷取到的影像調整測頭角度,使觸控面(即測試面)垂直法線與測試觸控桿30為同一軸線,並控制測試觸控桿30(即測試銅頭)接觸圓面積與 待測接觸面完全密合,成品之待測面板60可經由內建之wifi或Bluetooth等介面報點,由控制模組50進行路徑描繪。 The system structure of the present invention is to establish a control module 50 (such as a microcontroller; or a combination of computer and software) for autonomously tracking the vertical distance of the curved surface in three-dimensional space control, in which the Z axis is passed on X, Y, Z mobile platforms The control module 50 for self-tracking the vertical distance of the curved surface is under control. Two sets of movable A-axis and B-axis are installed on the Z-axis gantry. An image capturing device 41 with a photographic lens is mounted on the movable A-axis. A laser or LED is placed on the same axis to form a phase in front of the lens. The angle captured by the lens adjusts the angle of the probe so that the vertical normal of the touch surface (ie the test surface) is the same axis as the test touch lever 30, and Control the touch circle area of the test touch lever 30 (that is, the test copper head) and The contact surface to be tested is completely tight, and the finished panel to be tested 60 can be reported via the built-in wifi or Bluetooth interface, and the control module 50 can trace the path.

完成之三維空間控制即可針對三維空間曲面觸控面板檢測問題提供完整支持,以降低添購機械手臂處理3D曲面觸控面板成本,藉由待測面板60經由wifi或Bluetooth介面報點增加測驗彈性,降低工程師學習曲線降低傳換線工時。 The completed three-dimensional space control can provide complete support for the detection problems of the three-dimensional curved surface touch panel, so as to reduce the cost of purchasing a mechanical arm to handle the 3D curved surface touch panel, and increase the test flexibility by reporting the panel 60 to be reported via wifi or Bluetooth interface , Reduce the learning curve of engineers and reduce the man-hours of transfer lines.

本發明擬研發的系統結構如圖3所示,於裝置在Z軸上的A與B軸安置一組具備LED的光源40及具備鏡頭的影像擷取裝置41,可藉由LED光源40照射於待測面板60之觸控面61于鏡頭前成相,形成一具圓型的光點影像,藉由影像中之圓型光點的直軸與交軸距離判斷光點成相反射面曲面變化,並轉動Z軸與A、B兩軸向,以將鏡頭軸線調整至與觸控面61之法線重疊為止;亦即,使測試觸控桿30與觸控面61的接觸點之法線為同一軸線,如圖4、5所示。 The system structure to be developed by the present invention is shown in FIG. 3. A group of light sources 40 with LEDs and an image capturing device 41 with lenses are arranged on the A and B axes of the device on the Z axis. The touch surface 61 of the panel under test 60 is phased in front of the lens to form a circular light spot image. The distance between the straight axis and the intersecting axis of the circular light spot in the image is used to determine the change of the reflective surface of the light spot. , And rotate the Z axis and the two axes of A and B to adjust the lens axis until it overlaps the normal of the touch surface 61; that is, the normal of the contact point of the test touch lever 30 and the touch surface 61 For the same axis, as shown in Figures 4 and 5.

一般而言,自待測面板60反射成像的光點影像原圖必須經過影像處理,以將待測面板60反射之LED光源40的光點影像經由控制模組50之影像處理軟體將原圖彩色轉灰階並進行二值化與取出邊線轉換完成後,再用圓偵測對LED光點進行追蹤,圓偵測中從取像之光點影像中求得邊點的集合,通常用下列方程式來表示:V={(x,y)} (1) In general, the original image of the light spot image reflected from the panel under test 60 must undergo image processing to color the original image of the light source image of the LED light source 40 reflected by the panel under test 60 through the image processing software of the control module 50 After grayscale conversion, binarization and edge extraction, the LED spot is tracked using circle detection. In circle detection, the set of edge points is obtained from the captured spot image, usually using the following equation To express: V = {( x , y )} (1)

(x-a)2+(y-b)2=r 2 (2) ( x - a ) 2 +( y - b ) 2 = r 2 (2)

假設給定的邊點為(a,b),集合為V我們隨機的從V中挑出四點。該四點可以決定出四個圓,如圖6a所示。假設被選出的四個點皆來自同一個圓,於是即可說這四點決定出的圓是候選圓。 Assuming that the given edge points are ( a , b ) and the set is V, we randomly pick four points from V. The four points can determine four circles, as shown in Figure 6a. Assuming that the selected four points are all from the same circle, it can be said that the circle determined by these four points is a candidate circle.

本發明控制模組50之演算用控制系統係採用四核芯高速微處理器或微控制器,至於取像、真正圓運算、調整觸控檢測角度皆由控制模組50內建之影像處理及真正圓運算法自動完成。 The control system for the calculation of the control module 50 of the present invention adopts a four-core high-speed microprocessor or microcontroller. As for the image acquisition, true circle calculation, and adjustment of the touch detection angle, the built-in image processing and The real circle arithmetic is done automatically.

以下就各個部分說明,本發明所採用的理論為克拉瑪公式理論來決定候選圓,將式子(2)中的圓方程式改寫,可得下式:2xa+2yb+d=x 2+y 2 (3) The following is a description of each part. The theory adopted in the present invention is the theory of Klama formula to determine the candidate circle. Rewriting the circle equation in equation (2), we can obtain the following formula: 2 xa + 2 yb + d = x 2 + y 2 (3)

此處d=r 2-a 2-b 2。令v i =(x i ,y i ),i=1,2,3為影像中邊點集中被隨機挑選出來的三個邊點。假若v 1,v 2,v 3沒有共線,則他們可以決定一圓C 123,且可以得到圓心(a 123,b 123)和半徑r 123Here d = r 2 - a 2 - b 2 . Let v i =( x i , y i ), i =1,2,3 be three randomly selected edge points in the image. If v 1 , v 2 , and v 3 are not collinear, they can determine a circle C 123 and get the center of the circle ( a 123 , b 123 ) and the radius r 123 .

圓心和半徑:將三個邊點v 1=(x 1,y 1),v 2=(x 2,y 2),v 3=(x 3,y 3)代入(3)式子可得 Center and radius: Substitute the three edge points v 1 =( x 1 , y 1 ), v 2 =( x 2 , y 2 ), v 3 =( x 3 , y 3 ) into (3)

此處Here .

利用圓心(a 123,b 123)的解,我們進而解得圓半徑如下: Using the solution of the center of the circle ( a 123 , b 123 ), we can get the radius of the circle as follows:

本發明所採用的理論為克拉瑪公式理論來決定候選圓,將式子(2)中的圓方程式改寫,可得下式:v 1,v 2,v 3共線時:若是依上列各式推導結論所選定的三個邊點值,不幸可以滿足等式(x 2-x 1)(y 3-y 1)-(x 3-x 1)(y 2-y 1)=0則意謂被隨機挑選的三個邊點v 1,v 2,v 3共線。也就是說他們無法形成一個圓。令v 4=(x 4,y 4)為第四個被挑選的邊點,令該點至圓C 123的距離為d 4→123,可得下式: The theory adopted by the present invention is the theory of Klama formula to determine the candidate circle, and the circle equation in formula (2) is rewritten to obtain the following formula: when v 1 , v 2 , and v 3 are collinear: The three edge point values selected by the formula derivation conclusion can unfortunately satisfy the equation ( x 2 - x 1 )( y 3 - y 1 )-( x 3 - x 1 )( y 2 - y 1 )=0 means That is, the three randomly selected edge points v 1 , v 2 and v 3 are collinear. In other words, they cannot form a circle. Let v 4 = ( x 4 , y 4 ) be the fourth selected edge point, and let the distance from this point to the circle C 123 be d 4→123 , the following formula can be obtained:

假如v 4在圓C 123上,則式(7)為零。若式(7)中值夠小,則我們都視v 4在圓C 123的邊界上,如圖6b所示,給四個隨機邊點v i =(x i ,y i ),i=1,2,3,4,這四個邊點至多造成四個圓。其中由v i ,v j ,v k 造成的圓表為C ijk 且其圓心與半徑表示為(a ijk ,b ijk )和r ijk 。令v l 到圓C ijk 的距離為d lijk (參見式子(5)-(7))。則式子(7)可被改為: If v 4 is on circle C 123 , then equation (7) is zero. If the value in equation (7) is small enough, we all regard v 4 to be on the boundary of circle C 123 , as shown in Figure 6b, and give four random edge points v i =( x i , y i ), i =1 ,2,3,4, these four side points make up to four circles. The circle table caused by v i , v j , v k is C ijk and its center and radius are expressed as ( a ijk , b ijk ) and r ijk . Let the distance from v l to the circle C ijk be d lijk (see equations (5)-(7)). Then formula (7) can be changed to:

這裡主要的目標是從四個隨機選取的邊點中決定哪三點可形成一數位圓。同時第四個邊點也落在該圓的邊上。給四個點,共有個可能圓需進一步檢查來決定誰是最可能的圓。若取點夠多即可組合成一數位圓,如圖6c所示。 The main goal here is to decide from three randomly selected edge points which three points can form a digital circle. At the same time, the fourth edge point also falls on the edge of the circle. Give four points, a total of This possible circle needs further examination to determine who is the most probable circle. If there are enough points, they can be combined into a digital circle, as shown in Figure 6c.

在不理想的情形時,這種不理想的情形是發生在三個代理點中有二點很接近。於此,這個可能圓有很高的機率不為一真正圓。為了避免這種不理想的情形,我們希望任二個代理點之間的距離得超過一個門檻值。加上這個條件會讓由三個代理點決定的候選圓有更強的證據為真正圓,如圖6d所示。 In the non-ideal situation, this non-ideal situation occurs when two of the three agent points are very close. Here, this possible circle has a high probability of not being a true circle. In order to avoid this undesirable situation, we hope that the distance between any two agent points must exceed a threshold. Adding this condition will make the candidate circle determined by the three proxy points have stronger evidence as a true circle, as shown in Figure 6d.

在決定真正圓時,假設利用上面方法v i ,v j ,v k 決定了一個可能圓且此圓有圓心(a ijk ,b ijk )和半徑r ijk ,接下來我們加上一個門檻值T g 來檢查這個候選圓是否為真正圓。令計數器C的起始值為0。我們從邊點集V中挑選任何一邊點v l ,然後檢測距離d lijk 是否小於門檻值T d 。若是,則將C的值加一。然後,我們從剩餘的邊點集中再挑一邊點,繼續上述的距離計算和比較,一直到所有的邊點被處理完。若這時C的值大於門檻值T g ,則由v i ,v j ,v k 形成的候選圓即為真正圓。否則,該候選圓為一假圓。接下來,我們再將這C個邊點還回邊點集V。而制定C的門檻值的方法為假設該候選圓的圓心與半徑為(a ijk ,b ijk )和r ijk ,則需大於一個門檻值T r ,例如T r =0.8表示數字圓上的邊點需占圓周的80%。畢竟圓周上的點數與半徑是成正比的。這樣設的門檻值T r 較不受圓的大小之影響。 When determining the true circle, suppose that the above methods v i , v j , v k determine a possible circle with a circle center ( a ijk , b ijk ) and radius r ijk , then we add a threshold value T g To check if this candidate circle is a real circle. Let the initial value of counter C be 0. We select any edge point v l from the edge point set V , and then check whether the distance d lijk is less than the threshold value T d . If it is, the value of C is increased by one. Then, we pick one more point from the remaining set of edge points, and continue the above distance calculation and comparison until all the edge points are processed. If the value of C is greater than the threshold value T g at this time, the candidate circle formed by v i , v j , v k is the true circle. Otherwise, the candidate circle is a false circle. Next, we return these C edge points to the edge point set V. The method of formulating the threshold value of C is assuming that the center and radius of the candidate circle are ( a ijk , b ijk ) and r ijk , then It needs to be greater than a threshold value T r , for example, T r = 0.8 means that the edge points on the digital circle need to occupy 80% of the circumference. After all, the number of points on the circumference is proportional to the radius. Such a set threshold T r less susceptible to the influence of the size of the circle.

本發明所使用的控制模組50係為一種具備四核芯、64Bit、1.2GHz、記憶體容量1G的微控制器,本發明系統運作於LINUX作業系統之中,具高度自動化與平行演算功能,可並行處理影像、追蹤特定目標、週邊介面與感知器處理、不需特定3D掃瞄設備支援即可進行曲面觸控面板檢測,觸控面板檢測對象為成品;或半成品皆可,半成品以觸控面板之控制IC經由I2C、SPI、CAN BUS等訊號傳輸介面對控制模組50報點;另外,成品方面藉由待測主機安裝的程式APK經由內建之Bluetooth或Wifi等通訊模組對控制模組50進行報點。系統Z軸自動對待測物表面曲度調整固定於鏡頭旁的觸控銅頭,使銅頭角度與待測物表面曲面待測點的法線平行,檢測系統不需製作曲面3D路徑,僅以2D路徑圖面運作即可檢測3D曲面,縮短檢測時間。 The control module 50 used in the present invention is a microcontroller with four cores, 64Bit, 1.2GHz, and memory capacity of 1G. The system of the present invention operates in the LINUX operating system, with high automation and parallel calculation functions. It can process images in parallel, track specific targets, peripheral interfaces and sensor processing, and can perform curved touch panel detection without the support of specific 3D scanning devices. The touch panel detection object is finished products; or semi-finished products, semi-finished products can be touched The control IC of the panel reports to the control module 50 via I2C, SPI, CAN BUS and other signal transmission interfaces. In addition, the finished product is controlled by the program APK installed by the host under test through the built-in Bluetooth or Wifi communication module. Group 50 reports. The Z axis of the system automatically adjusts the curvature of the surface of the object to be measured and is fixed to the touch copper head next to the lens, so that the angle of the copper head is parallel to the normal of the surface to be measured on the surface of the object to be measured. The detection system does not need to make a curved 3D path. The operation of the 2D path drawing can detect the 3D curved surface and shorten the detection time.

請配合參看圖7所示,本發明待測觸控檢測的追縱影像處理製作方式如下: Please refer to FIG. 7 for the following, and the method for manufacturing the tracking image processing for touch detection under test of the present invention is as follows:

步驟一:先使用固定於Z軸上的轉向鏡頭模組,運用鏡頭上LED光源40照射在待測面板60表面所成相的光點影像。 Step 1: First use a steering lens module fixed on the Z axis, and use the LED light source 40 on the lens to illuminate the spot image formed on the surface of the panel 60 to be tested.

步驟二:將取得之彩色光點影像進行二值化處理,並透過軟體濾波器濾除不必要背景,並加強LED光點特徵。 Step 2: Binaryize the obtained color light spot image, and filter out unnecessary background through the software filter, and strengthen the LED light spot feature.

步驟三:運用Canny演算法取得影像邊緣,使得LED光點圓像更為凸出。 Step 3: Use the Canny algorithm to obtain the edge of the image to make the round spot of the LED light spot more prominent.

步驟四:運用克拉瑪公式理論來決定候選圓,並解出圓心與半徑,再經過圓的直軸與交軸比較確定為真正圓。 Step 4: Use the theory of Klama formula to determine the candidate circle, solve for the center and radius of the circle, and then determine the true circle by comparing the straight axis and the intersection axis of the circle.

步驟五:經由真正圓檢測,確定鏡頭軸線與待測物表面法線平行。 Step 5: Through the real circle detection, confirm that the lens axis is parallel to the surface normal of the object to be measured.

本發明鏡頭取像演算的實驗例,經過先期實驗結果如下: The experimental example of the lens acquisition calculation of the present invention has the following preliminary experimental results:

實驗例一:觸控曲面正面取像,圖8左側為取樣圖,圖8右側為影像處理後圖。 Experimental example one: Take a picture of the front of the touch curved surface. The left side of FIG. 8 is the sampling image, and the right side of FIG. 8 is the image after image processing.

實驗例二:觸控曲面正面遠距取像,圖9側為取樣圖,圖9右側為影像處理後圖。 Experimental example 2: Long-distance image acquisition on the front of the touch curved surface. The side of FIG. 9 is the sampling image, and the right side of FIG. 9 is the image after image processing.

實驗三:觸控曲面右偏遠距取像,圖10左側為取樣圖,圖10右側為影像處理後圖。 Experiment 3: Right-distance image acquisition of the touch surface. The left side of Fig. 10 is the sampling image, and the right side of Fig. 10 is the image after image processing.

實驗四:觸控曲面右偏取像,圖11左側為取樣圖,圖11右側為影像處理後圖。 Experiment 4: Right-biased capture of the touch surface. The left side of Fig. 11 is the sampling image, and the right side of Fig. 11 is the image after image processing.

實驗五:觸控曲面左偏取像,圖12左側為取樣圖,圖12右側為影像處理後圖。 Experiment 5: The left-handed image of the touch surface is taken. The left side of FIG. 12 is a sampling image, and the right side of FIG. 12 is an image after image processing.

實驗六:觸控曲面凸起取像,圖13左側為取樣圖,圖13右側為影像處理後圖。 Experiment 6: Touch curved convex image acquisition, the left side of Fig. 13 is the sampling image, and the right side of Fig. 13 is the image after image processing.

以上所述,僅為本發明之可行實施例,並非用以限定本發明之專利範圍,凡舉依據下列請求項所述之內容、特徵以及其精神而為之其他變化的等效實施,皆應包含於本發明之專利範圍內。本發明所具體界定於請求項之結構特徵,未見於同類物品,且具實用性與進步性,已符合發明專利要件,爰依法具文提出申請,謹請 鈞局依法核予專利,以維護本申請人合法之權益。 The above is only a feasible embodiment of the present invention and is not intended to limit the patent scope of the present invention. Any equivalent implementation of other changes based on the content, features and spirit described in the following claims should be Included in the patent scope of the present invention. The structural features of the invention specifically defined in the claim are not found in similar items, and are practical and progressive. They have met the requirements of the invention patent. You have filed an application in accordance with the law, and I would like to ask the Jun Bureau to approve the patent in accordance with the law to maintain this. The applicant's legal rights and interests.

Claims (9)

一種三維空間觸控面板檢測系統,其包括:一三軸移動平台,其可供放置至少一待測面板,該三軸移動平台包含可分別往三個不同軸向位移的一第一驅動機構、一第二驅動機構及一第三驅動機構;一多軸旋轉機構,其設於該第三驅動機構上,用以做出至少二種軸向的旋轉;至少一測試觸控桿,其設於該多軸旋轉機構,可隨著該多軸旋轉機構位移及旋轉,以對該待測面板之一觸控面進行觸控檢測;一光源,其設於該多軸旋轉機構靠近該測試觸控桿的位置上,用以朝向該待測面板之該觸控面投射光源;一影像擷取裝置,其設於該多軸旋轉機構靠近該光源的位置上,用以擷取該待測面板反射該光源的光點影像;及一控制模組,其內建有至少一預設路徑,並依據該預設路徑控制該三軸移動平台做出對應的位移,再對該光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制該多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使該測試觸控桿之軸線與該觸控面的接觸點之法線為同一軸線;或是接近同一軸線。A three-dimensional space touch panel detection system includes: a three-axis mobile platform for placing at least one panel to be tested, the three-axis mobile platform includes a first driving mechanism that can be displaced to three different axial directions, A second drive mechanism and a third drive mechanism; a multi-axis rotation mechanism, which is arranged on the third drive mechanism, to make at least two kinds of axial rotation; at least one test touch lever, which is arranged on The multi-axis rotation mechanism can follow the displacement and rotation of the multi-axis rotation mechanism to perform touch detection on a touch surface of the panel to be tested; a light source is provided on the multi-axis rotation mechanism close to the test touch The position of the rod is used to project the light source toward the touch surface of the panel under test; an image capture device is provided at a position of the multi-axis rotation mechanism close to the light source to capture the reflection of the panel under test A light spot image of the light source; and a control module, which has at least one preset path built in, and controls the three-axis mobile platform to make a corresponding displacement according to the preset path, and then performs image processing on the light spot image And true circle arithmetic, and control the multi-axis rotation mechanism to make corresponding single-axis or two-axis rotation according to the calculation result, so as to make the axis of the test touch lever and the touch surface The normal of the contact point is the same axis; or close to the same axis. 如請求項1所述之三維空間觸控面板檢測系統,其中,該影像擷取裝置與該光源位於該測試觸控桿的上方附近的位置上。The three-dimensional space touch panel detection system according to claim 1, wherein the image capturing device and the light source are located at a position near the top of the test touch rod. 如請求項1所述之三維空間觸控面板檢測系統,其中,該多軸旋轉機構包含一可往水平向轉動的水平旋轉機構,一可往縱向轉動的縱向旋轉機構;該水平旋轉機構設於該第三驅動機構的一致動桿末端上;該縱向旋轉機構設於該水平旋轉機構底部,該影像擷取裝置與該光源設於該縱向旋轉機構上。The three-dimensional space touch panel detection system according to claim 1, wherein the multi-axis rotation mechanism includes a horizontal rotation mechanism capable of rotating horizontally, and a vertical rotation mechanism capable of rotating longitudinally; the horizontal rotation mechanism is provided at The end of the actuating rod of the third driving mechanism; the longitudinal rotation mechanism is arranged at the bottom of the horizontal rotation mechanism; the image capturing device and the light source are arranged on the longitudinal rotation mechanism. 如請求項1所述之三維空間觸控面板檢測系統,其中,該預設路徑係為2D平面的路徑資料。The three-dimensional space touch panel detection system according to claim 1, wherein the predetermined path is path data of a 2D plane. 如請求項1所述之三維空間觸控面板檢測系統,其中,該影像處理包含以下步驟:步驟一:將擷取得之彩色該光點影像轉換為灰階影像;步驟二:運用Canny演算法取得灰階之該光點影像的影像邊緣;及步驟三:對該影像邊緣進行影像二值化處理。The three-dimensional space touch panel detection system according to claim 1, wherein the image processing includes the following steps: Step 1: Convert the captured color light spot image into grayscale image; Step 2: Use Canny algorithm to obtain The image edge of the light spot image in gray scale; and Step 3: Perform image binarization processing on the image edge. 如請求項1所述之三維空間觸控面板檢測系統,其中,該真正圓運算法包含以下步驟:步驟一:輸入該光點影像的邊點數;步驟二:邊點集中隨機選擇四個邊點;步驟三:運用克拉瑪公式理論來決定候選圓,並解出圓心與半徑,再經過圓的直軸與交軸比較確定是否為真正圓;步驟四:判斷真正圓失敗數是否小於容忍數;判斷結果為是,則回到步驟二;判斷結果為否,則進入步驟六;及步驟六:移動該影像擷取裝置之一鏡頭對準圓心。The three-dimensional space touch panel detection system according to claim 1, wherein the true circle algorithm includes the following steps: Step 1: input the number of edge points of the light point image; Step 2: randomly select four edges in the edge point set Point; step three: use the theory of Klama formula to determine the candidate circle, and solve for the center and radius of the circle, and then determine whether it is a true circle through the straight axis of the circle and the intersection axis; step four: determine whether the number of true circle failures is less than the tolerance number ; If the judgment result is yes, go back to step two; if the judgment result is no, go to step six; and Step six: move one lens of the image capture device to align with the center of the circle 一種三維空間觸控面板檢測方法,其包括:提供一三軸移動平台、一多軸旋轉機構、至少一測試觸控桿、一光源、一影像擷取裝置及一控制模組;其中,該三軸移動平台包含可分別往三個不同軸向位移的一第一驅動機構、一第二驅動機構及一第三驅動機構;該多軸旋轉機構設於該第三驅動機構,用以做出至少二個軸向的旋轉;該測試觸控桿設於該多軸旋轉機構,可隨著該多軸旋轉機構位移及旋轉而對一置於該三軸移動平台的至少一待測面板進行觸控檢測;該光源設於該多軸旋轉機構靠近該測試觸控桿的位置上,用以朝向該待測面板之一觸控面投射光源;該影像擷取裝置設於該多軸旋轉機構靠近該光源的位置上,用以擷取該待測面板反射該光源的光點影像;及於該控制模組內建有至少一預設路徑,並依據該預設路徑控制該三軸移動平台做出對應的位移,再對該光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制該多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使該測試觸控桿與該觸控面的接觸點之法線為同一軸線;或是接近同一軸線。A three-dimensional space touch panel detection method, which includes: providing a three-axis mobile platform, a multi-axis rotation mechanism, at least one test touch lever, a light source, an image capture device, and a control module; wherein, the three The axis moving platform includes a first drive mechanism, a second drive mechanism, and a third drive mechanism that are respectively displaceable in three different axial directions; the multi-axis rotation mechanism is provided on the third drive mechanism to make at least Two axial rotations; the test touch lever is provided on the multi-axis rotation mechanism, which can touch at least one panel to be tested placed on the three-axis mobile platform as the multi-axis rotation mechanism is displaced and rotated Detection; the light source is provided at a position of the multi-axis rotation mechanism close to the test touch lever for projecting the light source toward a touch surface of the panel to be tested; the image capture device is provided at the multi-axis rotation mechanism close to the The position of the light source is used to capture the light point image of the light source reflected by the panel under test; and at least one preset path is built in the control module, and the three-axis mobile platform is controlled according to the preset path to make Corresponding displacement, then perform image processing and true circle arithmetic operation on the spot image, and control the multi-axis rotation mechanism to make corresponding single-axis or two-axis rotation according to the calculation result, so as to make The normal of the contact point of the test touch rod and the touch surface is the same axis; or close to the same axis. 如請求項7所述之三維空間觸控面板檢測方法,其中,該影像處理包含以下步驟:步驟一:將擷取得之彩色該光點影像轉換為灰階影像;步驟二:運用Canny演算法取得灰階之該光點影像的影像邊緣;及步驟三:對該影像邊緣進行影像二值化處理。The method for detecting a three-dimensional space touch panel according to claim 7, wherein the image processing includes the following steps: Step 1: convert the captured color spot image into a grayscale image; Step 2: use the Canny algorithm to obtain The image edge of the light spot image in gray scale; and Step 3: Perform image binarization processing on the image edge. 如請求項7所述之三維空間觸控面板檢測方法,其中,該真正圓運算法包含以下步驟:步驟一:輸入該光點影像的邊點數;步驟二:邊點集中隨機選擇四個邊點;步驟三:運用克拉瑪公式理論來決定候選圓,並解出圓心與半徑,再經過圓的直軸與交軸比較確定為真正圓;步驟四:判斷真正圓失敗數是否小於容忍數;判斷結果為是則回到步驟二;判斷結果為否則進入步驟六;及步驟六:移動該影像擷取裝置之一鏡頭對準圓心。The method for detecting a three-dimensional space touch panel according to claim 7, wherein the true circle operation method includes the following steps: Step 1: input the number of edge points of the light point image; Step 2: randomly select four edges in the edge point set Point; step three: use the theory of Klama formula to determine the candidate circle, and solve for the center and radius of the circle, and then determine the true circle by comparing the straight axis and the intersection axis of the circle; step four: determine whether the number of true circle failures is less than the tolerance number; If the judgment result is yes, go back to step two; if the judgment result is otherwise, go to step six; and step six: move one lens of the image capturing device to align the center of the circle.
TW106119883A 2017-06-14 2017-06-14 Three-dimensional space touch panel detection system and method TWI633278B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106119883A TWI633278B (en) 2017-06-14 2017-06-14 Three-dimensional space touch panel detection system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106119883A TWI633278B (en) 2017-06-14 2017-06-14 Three-dimensional space touch panel detection system and method

Publications (2)

Publication Number Publication Date
TWI633278B true TWI633278B (en) 2018-08-21
TW201905418A TW201905418A (en) 2019-02-01

Family

ID=63959713

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106119883A TWI633278B (en) 2017-06-14 2017-06-14 Three-dimensional space touch panel detection system and method

Country Status (1)

Country Link
TW (1) TWI633278B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6111234A (en) * 1991-05-07 2000-08-29 Batliwalla; Neville S. Electrical device
TW201245706A (en) * 2010-11-15 2012-11-16 Koh Young Tech Inc Board inspection method
TWM468673U (en) * 2013-06-14 2013-12-21 Morga Test Inc Touch panel inspection device and touch panel inspection system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6111234A (en) * 1991-05-07 2000-08-29 Batliwalla; Neville S. Electrical device
TW201245706A (en) * 2010-11-15 2012-11-16 Koh Young Tech Inc Board inspection method
TWM468673U (en) * 2013-06-14 2013-12-21 Morga Test Inc Touch panel inspection device and touch panel inspection system

Also Published As

Publication number Publication date
TW201905418A (en) 2019-02-01

Similar Documents

Publication Publication Date Title
JP6865865B2 (en) Product quality inspection improvement method and system by robot
US10383498B2 (en) Systems and methods to command a robotic cleaning device to move to a dirty region of an area
CN104023906B (en) Operation management device and operation management system
JP6960980B2 (en) Image-based tray alignment and tube slot positioning in visual systems
CN207036661U (en) A kind of Systems for optical inspection based on six-joint robot
TWM556842U (en) Testing device for curved touch panel
CN103797446A (en) Method for detecting motion of input body and input device using same
JP2013506209A (en) Method and apparatus for detecting a gazing point based on face detection and image measurement
US20220092757A1 (en) Grading cosmetic appearance of a test object
CN105424726A (en) Machine vision based light-emitting panel detection method
TWI699525B (en) Three-dimensional phase shift defect detection method and system
CN108731602A (en) Object thickness measurement system, method, detection device and computer program product
CN210803323U (en) Curved surface glass defect detecting system
KR20210091189A (en) Optimization of setup steps in automated visual inspection processes
US20170151676A1 (en) Optical measurement of object location in three dimensions
US20170371123A1 (en) Method and system for multi-lens module alignment
TWI585395B (en) Panel inspection apparatus and method
TWI633278B (en) Three-dimensional space touch panel detection system and method
TWI662248B (en) Detection method and system for three-dimensional touch panel by two-fingers touching
CN204405005U (en) A kind of glass size on-line detecting system
US10656097B2 (en) Apparatus and method for generating operation program of inspection system
JP7217911B2 (en) Contamination inspection system
TWI662251B (en) Three-dimensional linear detection method and system
US20170080569A1 (en) Apparatus, methods, computer programs, and non-transitory computer readable storage mediums for controlling movement of robotic machinery relative to an object
CN105653101B (en) Touch point sensing method and optical touch system

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees