TWI633278B - Three-dimensional space touch panel detection system and method - Google Patents
Three-dimensional space touch panel detection system and method Download PDFInfo
- Publication number
- TWI633278B TWI633278B TW106119883A TW106119883A TWI633278B TW I633278 B TWI633278 B TW I633278B TW 106119883 A TW106119883 A TW 106119883A TW 106119883 A TW106119883 A TW 106119883A TW I633278 B TWI633278 B TW I633278B
- Authority
- TW
- Taiwan
- Prior art keywords
- axis
- image
- touch
- rotation mechanism
- circle
- Prior art date
Links
Abstract
本發明揭露一種三維空間觸控面板檢測系統及其方法,其包括三軸移動平台、多軸旋轉機構、測試觸控桿、光源、影像擷取裝置及控制模組。多軸旋轉機構設於三軸移動平台之第三驅動機構。測試觸控桿可隨多軸旋轉機構位移旋轉而對待測面板進行觸控檢測。光源設於多軸旋轉機構靠上,用以朝向待測面板投射光源。影像擷取裝置用以擷取待測面板反射光源的光點影像。控制模組依據預設路徑控制三軸移動平台做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿與觸控面的接觸點之法線為同一軸線,俾能降低生產成本及簡化測試標準路徑,以達到最佳曲面量測檢測設備水準。 The invention discloses a three-dimensional space touch panel detection system and method, which includes a three-axis mobile platform, a multi-axis rotation mechanism, a test touch lever, a light source, an image capture device, and a control module. The multi-axis rotating mechanism is provided on the third driving mechanism of the three-axis moving platform. The test touch lever can perform touch detection on the panel under test with the rotation of the multi-axis rotation mechanism. The light source is arranged above the multi-axis rotation mechanism and is used to project the light source toward the panel to be tested. The image capturing device is used to capture the light spot image of the reflective light source of the panel under test. The control module controls the three-axis mobile platform to make the corresponding displacement according to the preset path, and then performs image processing and true circle arithmetic operation on the light spot image, and controls the multi-axis rotating mechanism to make the corresponding uniaxial axis according to the calculation result Or the two axial rotations are used to make the normal of the contact point of the test touch lever and the touch surface the same axis, so as to reduce the production cost and simplify the test standard path, so as to achieve the best surface measurement and inspection equipment level.
Description
本發明係有關一種三維空間觸控面板檢測系統及其方法,尤指一種可以降低生產成本及簡化測試標準路徑而達到最佳曲面量測檢測設備水準的觸控面板檢測技術。 The invention relates to a three-dimensional space touch panel detection system and method, in particular to a touch panel detection technology that can reduce production costs and simplify test standard paths to achieve the best curved surface measurement and detection equipment level.
根據日經新聞報導,住友化學(Sumitomo Chemical)將增產搭載OLED面板智慧手機用曲面觸控面板產品,目標在2018年初將曲面觸控面板產能擴增至每年1億支手機需求。主因在於,近年來,三星、蘋果(Apple)、等國際大廠之手機、平板、電腦、多媒體電視逐漸邁向曲面面板設計,目前工廠製造生產時所使用之檢測設備大多為檢測平面式觸控面板的裝置,並無專屬之三維曲面觸控面板的檢測裝置。 According to a Nikkei news report, Sumitomo Chemical will increase the production of curved touch panel products for smartphones equipped with OLED panels. It aims to expand the capacity of curved touch panels to 100 million mobile phones per year in early 2018. The main reason is that in recent years, mobile phones, tablets, computers, and multimedia TVs of Samsung, Apple, and other international manufacturers have gradually moved toward curved panel design. At present, most of the testing equipment used in factory production and production are flat touch detection. The panel device does not have a dedicated three-dimensional curved touch panel detection device.
雖有少數廠商開發出曲面觸控面板檢測裝置,但是此種曲面觸控面板檢測裝置大多是以機械手臂來檢測處理3D曲面觸控面板,雖然機械手臂可以用來檢測3D曲面的觸控面板;惟,應用機械手臂檢測處理3D曲面觸控面板檢測設備的成本過高,以致影響廠商裝設的意願,致使機械手臂無法普及成為檢測曲面觸控面板的必要檢測裝置;不僅如此,所需的位移路徑控制,就會讓工程師的學習曲線拉長,以致大幅增加人力與時間的耗費成本,因而造成曲面觸控面板檢測上的不便與極大的困擾情事產生。 Although a few manufacturers have developed curved touch panel detection devices, most of these curved touch panel detection devices use mechanical arms to detect and process 3D curved touch panels, although robotic arms can be used to detect 3D curved touch panels; However, the cost of applying a robotic arm to process 3D curved touch panel inspection equipment is too high, which affects the manufacturer's willingness to install, so that the robotic arm cannot be popularized as a necessary inspection device for detecting curved touch panel; not only that, the required displacement Path control will lengthen the learning curve of engineers, which will greatly increase the cost of manpower and time, thus causing inconvenience and great troubles in the detection of curved touch panels.
有鑒於此,平面式觸控面板檢測設備已行之有年,產品技術之成熟度未臻完善,仍有再改善的必要性,因此,如何開發出一套可以自主追尋曲面而達到觸控檢測目的及簡化產生測試標準路徑的觸控面板檢測技術實已成為相關產學業者所亟需挑戰與克服的技術課題。 In view of this, the planar touch panel inspection equipment has been in operation for many years, the maturity of the product technology has not been perfected, and there is still a need for further improvement. Therefore, how to develop a set that can independently pursue the curved surface to achieve touch inspection Purpose and simplification of touch panel inspection technology for generating test standard paths has become a technical issue that is urgently needed to be challenged and overcome by relevant industry and academics.
本發明所欲解決的技術課題在於,解決目前應用機械手臂檢測處理3D曲面觸控面板檢測成本高以及工程師學習曲線過長的問題。 The technical problem to be solved by the present invention is to solve the problems of high detection cost of the 3D curved touch panel currently detected by the mechanical arm detection processing and the long learning curve of the engineer.
本發明第一目的在於提供一種三維空間觸控面板檢測系統及其方法,主要是以平面觸控面板檢測裝置為基礎架構,並在平面觸控面板檢測裝置之Z軸裝設自主追尋曲面垂直距離的控制機制,除了可以實現自主追尋曲面而達到曲面觸控檢測之目的之外,並可降低生產成本及簡化產生測試標準路徑,進而達到最佳曲面量測檢測設備水準。達成本發第一明目及解決問題的技術手段,係包括三軸移動平台、多軸旋轉機構、測試觸控桿、光源、影像擷取裝置及控制模組。多軸旋轉機構設於三軸移動平台之第三驅動機構。測試觸控桿可隨多軸旋轉機構位移旋轉而對待測面板進行觸控檢測。光源設於多軸旋轉機構靠上,用以朝向待測面板投射光源。影像擷取裝置用以擷取待測面板反射光源的光點影像。控制模組依據預設路徑控制三軸移動平台做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿與觸控面的接觸點之法線為同一軸線或是處於接近該軸線的角度。 The first object of the present invention is to provide a three-dimensional space touch panel detection system and method, which is mainly based on a planar touch panel detection device, and is equipped with an independent tracking surface vertical distance on the Z axis of the planar touch panel detection device In addition to the control mechanism that can realize the independent tracking of the surface to achieve the purpose of surface touch detection, it can also reduce production costs and simplify the production of standard test paths, thereby achieving the best level of surface measurement and testing equipment. The technical means to achieve the first goal and solve the problem include three-axis mobile platform, multi-axis rotation mechanism, test touch lever, light source, image capture device and control module. The multi-axis rotating mechanism is provided on the third driving mechanism of the three-axis moving platform. The test touch lever can perform touch detection on the panel under test with the rotation of the multi-axis rotation mechanism. The light source is arranged above the multi-axis rotation mechanism and is used to project the light source toward the panel to be tested. The image capturing device is used to capture the light spot image of the reflective light source of the panel under test. The control module controls the three-axis mobile platform to make the corresponding displacement according to the preset path, and then performs image processing and true circle arithmetic operation on the light spot image, and controls the multi-axis rotating mechanism to make the corresponding uniaxial axis according to the calculation result Or two axial rotations, so that the normal of the contact point of the test touch lever and the touch surface is the same axis or at an angle close to the axis.
本發明第二目的在於提供一種可以有效縮短檢測時間的三 維空間觸控面板檢測系統及其方法,在不需製作曲面3D預設路徑資料的情況下,僅以2D預設路徑資料之運作即可檢測3D曲面的待測面板,進而達到有效縮短檢測時間的功效。達成本發第二明目的採用之技術手段,係包括三軸移動平台、多軸旋轉機構、測試觸控桿、光源、影像擷取裝置及控制模組。多軸旋轉機構設於三軸移動平台之第三驅動機構。測試觸控桿可隨多軸旋轉機構位移旋轉而對待測面板進行觸控檢測。光源設於多軸旋轉機構靠上,用以朝向待測面板投射光源。影像擷取裝置用以擷取待測面板反射光源的光點影像。控制模組依據預設路徑控制三軸移動平台做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿與觸控面的接觸點之法線為同一軸線或是處於接近該軸線的角度。其中,本實施例主要在於,上述預設路徑係為2D平面的路徑資料。 The second object of the present invention is to provide a method which can effectively shorten the detection time. A three-dimensional space touch panel detection system and method thereof, without the need to create curved 3D preset path data, only the operation of 2D preset path data can detect the 3D curved surface to be tested, thereby effectively shortening the detection time Effect. The technical means adopted to achieve the second most obvious objective include three-axis mobile platform, multi-axis rotation mechanism, test touch lever, light source, image capture device and control module. The multi-axis rotating mechanism is provided on the third driving mechanism of the three-axis moving platform. The test touch lever can perform touch detection on the panel under test with the rotation of the multi-axis rotation mechanism. The light source is arranged above the multi-axis rotation mechanism and is used to project the light source toward the panel to be tested. The image capturing device is used to capture the light spot image of the reflective light source of the panel under test. The control module controls the three-axis mobile platform to make the corresponding displacement according to the preset path, and then performs image processing and true circle arithmetic operation on the light spot image, and controls the multi-axis rotating mechanism to make the corresponding uniaxial axis according to the calculation result Or two axial rotations, so that the normal of the contact point of the test touch lever and the touch surface is the same axis or at an angle close to the axis. Wherein, this embodiment mainly lies in that the above-mentioned predetermined path is the path data of the 2D plane.
10‧‧‧三軸移動平台 10‧‧‧Three axis mobile platform
11‧‧‧第一驅動機構 11‧‧‧ First driving mechanism
12‧‧‧第二驅動機構 12‧‧‧ Second drive mechanism
13‧‧‧第三驅動機構 13‧‧‧ Third drive mechanism
20‧‧‧多軸旋轉機構 20‧‧‧Multi-axis rotating mechanism
21‧‧‧水平旋轉機構 21‧‧‧horizontal rotating mechanism
22‧‧‧縱向旋轉機構 22‧‧‧Longitudinal rotation mechanism
30‧‧‧測試觸控桿 30‧‧‧Test Touch Bar
40‧‧‧光源 40‧‧‧Light source
41‧‧‧影像擷取裝置 41‧‧‧Image capture device
鏡頭 Lens
50‧‧‧控制模組 50‧‧‧Control module
60‧‧‧待測面板 60‧‧‧ Panel to be tested
61‧‧‧觸控面 61‧‧‧Touch surface
圖1係本發明功能方塊的實施示意圖。 FIG. 1 is a schematic diagram of the implementation of the functional blocks of the present invention.
圖2係本發明具體架構實施的外觀示意圖。 FIG. 2 is a schematic view of the implementation of the specific architecture of the present invention.
圖3係本發明多軸旋轉機構的具體實施示意圖。 FIG. 3 is a schematic diagram of a specific implementation of the multi-axis rotation mechanism of the present invention.
圖4係本發明測試觸控桿測試不同形狀觸控面的實施示意圖。 FIG. 4 is a schematic diagram of an embodiment of the present invention for testing touch bars to test touch surfaces with different shapes.
圖5係本發明觸控面的法線分佈的實施示意圖。 5 is a schematic diagram of the normal distribution of the touch surface of the present invention.
圖6係本發明真正圓運算法的運算實施示意圖。 FIG. 6 is a schematic diagram of the operation of the real circle calculation method of the present invention.
圖7係本發明影像處理及真正圓運算法的流程控制實施示意圖。 7 is a schematic diagram of the flow control implementation of the image processing and true circle arithmetic method of the present invention.
圖8係本發明第一實驗例的影像對照實施示意圖。 FIG. 8 is a schematic diagram of an image comparison implementation of the first experimental example of the present invention.
圖9係本發明第二實驗例的影像對照實施示意圖。 9 is a schematic diagram of an image comparison implementation of a second experimental example of the present invention.
圖10係本發明第三實驗例的影像對照實施示意圖。 FIG. 10 is a schematic diagram of an image comparison implementation of a third experimental example of the present invention.
圖11係本發明第四實驗例的影像對照實施示意圖。 FIG. 11 is a schematic diagram of an image comparison implementation of a fourth experimental example of the present invention.
圖12係本發明第五實驗例的影像對照實施示意圖。 FIG. 12 is a schematic diagram of an image comparison implementation of a fifth experimental example of the present invention.
圖13係本發明第六實驗例的影像對照實施示意圖。 FIG. 13 is a schematic diagram of an image comparison implementation of a sixth experimental example of the present invention.
為讓 貴審查委員能進一步瞭解本發明整體的技術特徵與達成本發明目的之技術手段,玆以具體實施例並配合圖式加以詳細說明如下:請配合參看圖1~5所示為達成本發明第一目的之具體實施例,係包括三軸移動平台10、多軸旋轉機構20、測試觸控桿30、光源40、影像擷取裝置41及控制模組50等技術特徵。多軸旋轉機構20設於三軸移動平台10之第三驅動機構13。三軸移動平台10可供放置至少一待測面板60,該三軸移動平台10包含可分別往三個不同軸向位移的一第一驅動機構11(即往X軸向位移)、一第二驅動機構12(即往Y軸向位移)及一第三驅動機構13(即往Z軸向位移)。多軸旋轉機構20設於第三驅動機構13上,用以做出至少二種軸向(即水平向與縱向』的旋轉。測試觸控桿30(即測試銅頭)設於多軸旋轉機構20,可隨著多軸旋轉機構20位移及旋轉,以對待測面板60進行觸控檢測。光源40(如發光二極體LED;或是雷射)其設於多軸旋轉機構20靠近測試觸控桿30的位置上,用以朝向待測面板60之觸控面61投射光源。影像擷取裝置41設於多軸旋轉機構20靠近光源40的位置上,用以擷取自待測面板60所反射光源的光點影像。控制模組50內建有至少一預設路徑,並依據此預設路徑控制三軸移動平台10做出對應的位移,再對光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構20做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿30 之軸線與觸控面61接觸點的法線為同一軸線;或是接近同一軸線;換言之,該軸線與該法線重合,或是接近重合的狀態。至於『接近同一軸線』與『接近重合的狀態』是指測試觸控桿30之該軸線與接觸點的該法線的夾角小於3度而言。 In order for your reviewer to further understand the overall technical features of the present invention and the technical means for achieving the purpose of the invention, the specific embodiments and drawings are used to explain in detail as follows: Please refer to Figures 1 to 5 for the invention The specific embodiment of the first object includes technical features such as a three-axis mobile platform 10, a multi-axis rotation mechanism 20, a test touch lever 30, a light source 40, an image capture device 41, and a control module 50. The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 of the three-axis moving platform 10. The three-axis mobile platform 10 can accommodate at least one panel under test 60. The three-axis mobile platform 10 includes a first driving mechanism 11 (that is, an X-axis displacement) that can be displaced to three different axial directions, and a second The driving mechanism 12 (that is, the displacement toward the Y axis) and a third driving mechanism 13 (that is, the displacement toward the Z axis). The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 to make at least two kinds of axial (namely horizontal and vertical) rotations. The test touch lever 30 (ie testing the copper head) is provided on the multi-axis rotating mechanism 20. The multi-axis rotation mechanism 20 can be displaced and rotated to perform touch detection on the test panel 60. A light source 40 (such as a light-emitting diode LED; or a laser) is disposed on the multi-axis rotation mechanism 20 near the test touch The position of the lever 30 is used to project the light source toward the touch surface 61 of the panel under test 60. The image capturing device 41 is provided at a position of the multi-axis rotation mechanism 20 close to the light source 40 for capturing from the panel under test 60 The light spot image of the reflected light source. The control module 50 has at least one preset path built in, and controls the three-axis mobile platform 10 to make a corresponding displacement according to the preset path, and then performs image processing and true circle on the light spot image The calculation of the arithmetic method, and according to the calculation result, the multi-axis rotating mechanism 20 is controlled to make corresponding single-axis or two-axis rotation to test the touch lever 30 The axis of the touch point and the normal of the touch point 61 are the same axis; or close to the same axis; in other words, the axis coincides with the normal, or is close to the state of coincidence. As for "near the same axis" and "nearly coincident state", it means that the angle between the axis of the touch lever 30 and the normal of the contact point is less than 3 degrees.
請配合參看圖3所示的實施例中,該影像擷取裝置41與光源40位於測試觸控桿30的上方附近的位置上。具體的,上述多軸旋轉機構20包含一可往水平向轉動的水平旋轉機構21,一可往縱向轉動的縱向旋轉機構22。水平旋轉機構21設於第三驅動機構13的致動桿130末端上。縱向旋轉機構22設於水平旋轉機構21底部,影像擷取裝置41與光源40設於縱向旋轉機構22上。 Please refer to the embodiment shown in FIG. 3, the image capturing device 41 and the light source 40 are located near the top of the test touch lever 30. Specifically, the multi-axis rotation mechanism 20 includes a horizontal rotation mechanism 21 that can rotate horizontally, and a vertical rotation mechanism 22 that can rotate vertically. The horizontal rotation mechanism 21 is provided on the end of the actuation lever 130 of the third drive mechanism 13. The vertical rotation mechanism 22 is provided at the bottom of the horizontal rotation mechanism 21, and the image capturing device 41 and the light source 40 are provided on the vertical rotation mechanism 22.
請配合參看圖1~5所示為達成本發明第二目的之具體實施例,係包括三軸移動平台10、多軸旋轉機構20、測試觸控桿30、光源40、影像擷取裝置41及控制模組50等技術特徵。多軸旋轉機構20設於三軸移動平台10之第三驅動機構13。三軸移動平台10可供放置至少一待測面板60,該三軸移動平台10包含可分別往三個不同軸向位移的一第一驅動機構11(即往X軸向位移)、一第二驅動機構12(即往Y軸向位移)及一第三驅動機構13(即往Z軸向位移)。多軸旋轉機構20設於第三驅動機構13上,用以做出至少二種軸向(即水平向與縱向』的旋轉。測試觸控桿30(即測試銅頭)設於多軸旋轉機構20,可隨著多軸旋轉機構20位移及旋轉,以對待測面板60進行觸控檢測。光源40(如發光二極體LED;或是雷射)其設於多軸旋轉機構20靠近測試觸控桿30的位置上,用以朝向待測面板60之觸控面61投射光源。影像擷取裝置41設於多軸旋轉機構20靠近光源40的位置上,用以擷取自待測面板60所反射光源的光點影像。控制模組50內建有至少一預設路徑,並依據此預設路徑控制三軸移動平台10做出對應的位移,再對 光點影像做影像處理及真正圓運算法的運算,並依據運算結果控制多軸旋轉機構20做出對應的單軸向或是二個軸向的旋轉,用以使測試觸控桿30與觸控面61的接觸點之法線為同一軸線;或是接近同一軸線,亦即,測試觸控桿30與該軸線的夾角介於0.1~3度的角度範圍。其中,本實施例主要在於,上述預設路徑係為2D平面的路徑資料,於此,即可在不需製作曲面3D預設路徑資料的情況下,僅以2D預設路徑資料之運作即可檢測3D曲面的待測面板60。 Please refer to FIGS. 1 to 5 for a specific embodiment of achieving the second object of the invention, which includes a three-axis mobile platform 10, a multi-axis rotation mechanism 20, a test touch lever 30, a light source 40, an image capture device 41 and Control module 50 and other technical features. The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 of the three-axis moving platform 10. The three-axis mobile platform 10 can accommodate at least one panel under test 60. The three-axis mobile platform 10 includes a first driving mechanism 11 (that is, an X-axis displacement) that can be displaced to three different axial directions, and a second The driving mechanism 12 (that is, the displacement toward the Y axis) and a third driving mechanism 13 (that is, the displacement toward the Z axis). The multi-axis rotating mechanism 20 is provided on the third driving mechanism 13 to make at least two kinds of axial (namely horizontal and vertical) rotations. The test touch lever 30 (ie testing the copper head) is provided on the multi-axis rotating mechanism 20. The multi-axis rotation mechanism 20 can be displaced and rotated to perform touch detection on the test panel 60. A light source 40 (such as a light-emitting diode LED; or a laser) is disposed on the multi-axis rotation mechanism 20 near the test touch The position of the lever 30 is used to project the light source toward the touch surface 61 of the panel under test 60. The image capturing device 41 is provided at a position of the multi-axis rotation mechanism 20 close to the light source 40 for capturing from the panel under test 60 The light spot image of the reflected light source. The control module 50 has at least one preset path built in, and controls the three-axis mobile platform 10 to make a corresponding displacement according to the preset path, and then The light spot image is processed by image processing and true circle arithmetic, and the multi-axis rotation mechanism 20 is controlled to make corresponding uniaxial or two-axis rotation according to the calculation result, which is used to test the touch lever 30 and touch The normal of the contact point of the control surface 61 is the same axis; or close to the same axis, that is, the angle between the test touch lever 30 and the axis is within an angle range of 0.1 to 3 degrees. Among them, this embodiment mainly lies in that the above-mentioned preset path is 2D plane path data. Here, it is possible to operate only with 2D default path data without making curved 3D default path data The 3D curved surface to be tested panel 60 is detected.
具體的,請配合參看圖7所示,上述控制模組50所做的影像處理係包含步驟一:將擷取得之彩色該光點影像轉換為灰階影像。步驟二:運用Canny演算法取得灰階之該光點影像的影像邊緣。步驟三:對該影像邊緣進行影像二值化處理。 Specifically, please refer to FIG. 7. The image processing performed by the control module 50 includes step 1: converting the captured color spot image into a grayscale image. Step 2: Use Canny algorithm to obtain the image edge of the light spot image in gray scale. Step 3: Perform image binarization on the image edge.
具體的,請配合參看圖7所示,上述控制模組50所做的真正圓運算法包含步驟一:輸入光點影像的邊點數。步驟二:邊點集中隨機選擇四個邊點。步驟三:運用克拉瑪公式理論來決定候選圓,並解出圓心與半徑,再經過圓的直軸與交軸比較確定是否為真正圓。步驟四:判斷真正圓失敗數是否小於容忍數;判斷結果為是,則回到步驟二;判斷結果為否,則進入步驟六。步驟六:移動該影像擷取裝置41之鏡頭對準圓心。 Specifically, please refer to FIG. 7. The real circle calculation method performed by the control module 50 includes step 1: inputting the number of edge points of the light spot image. Step 2: Randomly select four edge points. Step 3: Use the theory of Klama formula to determine the candidate circle, solve the center and radius of the circle, and then compare the straight axis and the intersection axis of the circle to determine whether it is a true circle. Step 4: Determine whether the true circle failure number is less than the tolerance number; if the judgment result is yes, return to step two; if the judgment result is no, go to step six. Step 6: Move the lens of the image capturing device 41 to the center of the circle.
本發明系統結構在於建立一種三維空間控制之自主追尋曲面垂直距離的控制模組50(如微控制器;或電腦與軟體的組合),其中在X,Y,Z移動平台上將Z軸交由自主追尋曲面垂直距離之控制模組50掌控,Z軸軸架上加裝二組活動A軸與B軸,於活動A軸上架設一具有攝影鏡頭的影像擷取裝置41,鏡頭上方與Z軸同軸線處架設雷射或是LED於鏡頭前成相,由鏡頭擷取到的影像調整測頭角度,使觸控面(即測試面)垂直法線與測試觸控桿30為同一軸線,並控制測試觸控桿30(即測試銅頭)接觸圓面積與 待測接觸面完全密合,成品之待測面板60可經由內建之wifi或Bluetooth等介面報點,由控制模組50進行路徑描繪。 The system structure of the present invention is to establish a control module 50 (such as a microcontroller; or a combination of computer and software) for autonomously tracking the vertical distance of the curved surface in three-dimensional space control, in which the Z axis is passed on X, Y, Z mobile platforms The control module 50 for self-tracking the vertical distance of the curved surface is under control. Two sets of movable A-axis and B-axis are installed on the Z-axis gantry. An image capturing device 41 with a photographic lens is mounted on the movable A-axis. A laser or LED is placed on the same axis to form a phase in front of the lens. The angle captured by the lens adjusts the angle of the probe so that the vertical normal of the touch surface (ie the test surface) is the same axis as the test touch lever 30, and Control the touch circle area of the test touch lever 30 (that is, the test copper head) and The contact surface to be tested is completely tight, and the finished panel to be tested 60 can be reported via the built-in wifi or Bluetooth interface, and the control module 50 can trace the path.
完成之三維空間控制即可針對三維空間曲面觸控面板檢測問題提供完整支持,以降低添購機械手臂處理3D曲面觸控面板成本,藉由待測面板60經由wifi或Bluetooth介面報點增加測驗彈性,降低工程師學習曲線降低傳換線工時。 The completed three-dimensional space control can provide complete support for the detection problems of the three-dimensional curved surface touch panel, so as to reduce the cost of purchasing a mechanical arm to handle the 3D curved surface touch panel, and increase the test flexibility by reporting the panel 60 to be reported via wifi or Bluetooth interface , Reduce the learning curve of engineers and reduce the man-hours of transfer lines.
本發明擬研發的系統結構如圖3所示,於裝置在Z軸上的A與B軸安置一組具備LED的光源40及具備鏡頭的影像擷取裝置41,可藉由LED光源40照射於待測面板60之觸控面61于鏡頭前成相,形成一具圓型的光點影像,藉由影像中之圓型光點的直軸與交軸距離判斷光點成相反射面曲面變化,並轉動Z軸與A、B兩軸向,以將鏡頭軸線調整至與觸控面61之法線重疊為止;亦即,使測試觸控桿30與觸控面61的接觸點之法線為同一軸線,如圖4、5所示。 The system structure to be developed by the present invention is shown in FIG. 3. A group of light sources 40 with LEDs and an image capturing device 41 with lenses are arranged on the A and B axes of the device on the Z axis. The touch surface 61 of the panel under test 60 is phased in front of the lens to form a circular light spot image. The distance between the straight axis and the intersecting axis of the circular light spot in the image is used to determine the change of the reflective surface of the light spot. , And rotate the Z axis and the two axes of A and B to adjust the lens axis until it overlaps the normal of the touch surface 61; that is, the normal of the contact point of the test touch lever 30 and the touch surface 61 For the same axis, as shown in Figures 4 and 5.
一般而言,自待測面板60反射成像的光點影像原圖必須經過影像處理,以將待測面板60反射之LED光源40的光點影像經由控制模組50之影像處理軟體將原圖彩色轉灰階並進行二值化與取出邊線轉換完成後,再用圓偵測對LED光點進行追蹤,圓偵測中從取像之光點影像中求得邊點的集合,通常用下列方程式來表示:V={(x,y)} (1) In general, the original image of the light spot image reflected from the panel under test 60 must undergo image processing to color the original image of the light source image of the LED light source 40 reflected by the panel under test 60 through the image processing software of the control module 50 After grayscale conversion, binarization and edge extraction, the LED spot is tracked using circle detection. In circle detection, the set of edge points is obtained from the captured spot image, usually using the following equation To express: V = {( x , y )} (1)
(x-a)2+(y-b)2=r 2 (2) ( x - a ) 2 +( y - b ) 2 = r 2 (2)
假設給定的邊點為(a,b),集合為V我們隨機的從V中挑出四點。該四點可以決定出四個圓,如圖6a所示。假設被選出的四個點皆來自同一個圓,於是即可說這四點決定出的圓是候選圓。 Assuming that the given edge points are ( a , b ) and the set is V, we randomly pick four points from V. The four points can determine four circles, as shown in Figure 6a. Assuming that the selected four points are all from the same circle, it can be said that the circle determined by these four points is a candidate circle.
本發明控制模組50之演算用控制系統係採用四核芯高速微處理器或微控制器,至於取像、真正圓運算、調整觸控檢測角度皆由控制模組50內建之影像處理及真正圓運算法自動完成。 The control system for the calculation of the control module 50 of the present invention adopts a four-core high-speed microprocessor or microcontroller. As for the image acquisition, true circle calculation, and adjustment of the touch detection angle, the built-in image processing and The real circle arithmetic is done automatically.
以下就各個部分說明,本發明所採用的理論為克拉瑪公式理論來決定候選圓,將式子(2)中的圓方程式改寫,可得下式:2xa+2yb+d=x 2+y 2 (3) The following is a description of each part. The theory adopted in the present invention is the theory of Klama formula to determine the candidate circle. Rewriting the circle equation in equation (2), we can obtain the following formula: 2 xa + 2 yb + d = x 2 + y 2 (3)
此處d=r 2-a 2-b 2。令v i =(x i ,y i ),i=1,2,3為影像中邊點集中被隨機挑選出來的三個邊點。假若v 1,v 2,v 3沒有共線,則他們可以決定一圓C 123,且可以得到圓心(a 123,b 123)和半徑r 123。 Here d = r 2 - a 2 - b 2 . Let v i =( x i , y i ), i =1,2,3 be three randomly selected edge points in the image. If v 1 , v 2 , and v 3 are not collinear, they can determine a circle C 123 and get the center of the circle ( a 123 , b 123 ) and the radius r 123 .
圓心和半徑:將三個邊點v 1=(x 1,y 1),v 2=(x 2,y 2),v 3=(x 3,y 3)代入(3)式子可得
此處。 Here .
利用圓心(a 123,b 123)的解,我們進而解得圓半徑如下:
本發明所採用的理論為克拉瑪公式理論來決定候選圓,將式子(2)中的圓方程式改寫,可得下式:v 1,v 2,v 3共線時:若是依上列各式推導結論所選定的三個邊點值,不幸可以滿足等式(x 2-x 1)(y 3-y 1)-(x 3-x 1)(y 2-y 1)=0則意謂被隨機挑選的三個邊點v 1,v 2,v 3共線。也就是說他們無法形成一個圓。令v 4=(x 4,y 4)為第四個被挑選的邊點,令該點至圓C 123的距離為d 4→123,可得下式:
假如v 4在圓C 123上,則式(7)為零。若式(7)中值夠小,則我們都視v 4在圓C 123的邊界上,如圖6b所示,給四個隨機邊點v i =(x i ,y i ),i=1,2,3,4,這四個邊點至多造成四個圓。其中由v i ,v j ,v k 造成的圓表為C ijk 且其圓心與半徑表示為(a ijk ,b ijk )和r ijk 。令v l 到圓C ijk 的距離為d l→ijk (參見式子(5)-(7))。則式子(7)可被改為:
這裡主要的目標是從四個隨機選取的邊點中決定哪三點可形成一數位圓。同時第四個邊點也落在該圓的邊上。給四個點,共有個可能圓需進一步檢查來決定誰是最可能的圓。若取點夠多即可組合成一數位圓,如圖6c所示。 The main goal here is to decide from three randomly selected edge points which three points can form a digital circle. At the same time, the fourth edge point also falls on the edge of the circle. Give four points, a total of This possible circle needs further examination to determine who is the most probable circle. If there are enough points, they can be combined into a digital circle, as shown in Figure 6c.
在不理想的情形時,這種不理想的情形是發生在三個代理點中有二點很接近。於此,這個可能圓有很高的機率不為一真正圓。為了避免這種不理想的情形,我們希望任二個代理點之間的距離得超過一個門檻值。加上這個條件會讓由三個代理點決定的候選圓有更強的證據為真正圓,如圖6d所示。 In the non-ideal situation, this non-ideal situation occurs when two of the three agent points are very close. Here, this possible circle has a high probability of not being a true circle. In order to avoid this undesirable situation, we hope that the distance between any two agent points must exceed a threshold. Adding this condition will make the candidate circle determined by the three proxy points have stronger evidence as a true circle, as shown in Figure 6d.
在決定真正圓時,假設利用上面方法v i ,v j ,v k 決定了一個可能圓且此圓有圓心(a ijk ,b ijk )和半徑r ijk ,接下來我們加上一個門檻值T g 來檢查這個候選圓是否為真正圓。令計數器C的起始值為0。我們從邊點集V中挑選任何一邊點v l ,然後檢測距離d l→ijk 是否小於門檻值T d 。若是,則將C的值加一。然後,我們從剩餘的邊點集中再挑一邊點,繼續上述的距離計算和比較,一直到所有的邊點被處理完。若這時C的值大於門檻值T g ,則由v i ,v j ,v k 形成的候選圓即為真正圓。否則,該候選圓為一假圓。接下來,我們再將這C個邊點還回邊點集V。而制定C的門檻值的方法為假設該候選圓的圓心與半徑為(a ijk ,b ijk )和r ijk ,則需大於一個門檻值T r ,例如T r =0.8表示數字圓上的邊點需占圓周的80%。畢竟圓周上的點數與半徑是成正比的。這樣設的門檻值T r 較不受圓的大小之影響。 When determining the true circle, suppose that the above methods v i , v j , v k determine a possible circle with a circle center ( a ijk , b ijk ) and radius r ijk , then we add a threshold value T g To check if this candidate circle is a real circle. Let the initial value of counter C be 0. We select any edge point v l from the edge point set V , and then check whether the distance d l → ijk is less than the threshold value T d . If it is, the value of C is increased by one. Then, we pick one more point from the remaining set of edge points, and continue the above distance calculation and comparison until all the edge points are processed. If the value of C is greater than the threshold value T g at this time, the candidate circle formed by v i , v j , v k is the true circle. Otherwise, the candidate circle is a false circle. Next, we return these C edge points to the edge point set V. The method of formulating the threshold value of C is assuming that the center and radius of the candidate circle are ( a ijk , b ijk ) and r ijk , then It needs to be greater than a threshold value T r , for example, T r = 0.8 means that the edge points on the digital circle need to occupy 80% of the circumference. After all, the number of points on the circumference is proportional to the radius. Such a set threshold T r less susceptible to the influence of the size of the circle.
本發明所使用的控制模組50係為一種具備四核芯、64Bit、1.2GHz、記憶體容量1G的微控制器,本發明系統運作於LINUX作業系統之中,具高度自動化與平行演算功能,可並行處理影像、追蹤特定目標、週邊介面與感知器處理、不需特定3D掃瞄設備支援即可進行曲面觸控面板檢測,觸控面板檢測對象為成品;或半成品皆可,半成品以觸控面板之控制IC經由I2C、SPI、CAN BUS等訊號傳輸介面對控制模組50報點;另外,成品方面藉由待測主機安裝的程式APK經由內建之Bluetooth或Wifi等通訊模組對控制模組50進行報點。系統Z軸自動對待測物表面曲度調整固定於鏡頭旁的觸控銅頭,使銅頭角度與待測物表面曲面待測點的法線平行,檢測系統不需製作曲面3D路徑,僅以2D路徑圖面運作即可檢測3D曲面,縮短檢測時間。 The control module 50 used in the present invention is a microcontroller with four cores, 64Bit, 1.2GHz, and memory capacity of 1G. The system of the present invention operates in the LINUX operating system, with high automation and parallel calculation functions. It can process images in parallel, track specific targets, peripheral interfaces and sensor processing, and can perform curved touch panel detection without the support of specific 3D scanning devices. The touch panel detection object is finished products; or semi-finished products, semi-finished products can be touched The control IC of the panel reports to the control module 50 via I2C, SPI, CAN BUS and other signal transmission interfaces. In addition, the finished product is controlled by the program APK installed by the host under test through the built-in Bluetooth or Wifi communication module. Group 50 reports. The Z axis of the system automatically adjusts the curvature of the surface of the object to be measured and is fixed to the touch copper head next to the lens, so that the angle of the copper head is parallel to the normal of the surface to be measured on the surface of the object to be measured. The detection system does not need to make a curved 3D path. The operation of the 2D path drawing can detect the 3D curved surface and shorten the detection time.
請配合參看圖7所示,本發明待測觸控檢測的追縱影像處理製作方式如下: Please refer to FIG. 7 for the following, and the method for manufacturing the tracking image processing for touch detection under test of the present invention is as follows:
步驟一:先使用固定於Z軸上的轉向鏡頭模組,運用鏡頭上LED光源40照射在待測面板60表面所成相的光點影像。 Step 1: First use a steering lens module fixed on the Z axis, and use the LED light source 40 on the lens to illuminate the spot image formed on the surface of the panel 60 to be tested.
步驟二:將取得之彩色光點影像進行二值化處理,並透過軟體濾波器濾除不必要背景,並加強LED光點特徵。 Step 2: Binaryize the obtained color light spot image, and filter out unnecessary background through the software filter, and strengthen the LED light spot feature.
步驟三:運用Canny演算法取得影像邊緣,使得LED光點圓像更為凸出。 Step 3: Use the Canny algorithm to obtain the edge of the image to make the round spot of the LED light spot more prominent.
步驟四:運用克拉瑪公式理論來決定候選圓,並解出圓心與半徑,再經過圓的直軸與交軸比較確定為真正圓。 Step 4: Use the theory of Klama formula to determine the candidate circle, solve for the center and radius of the circle, and then determine the true circle by comparing the straight axis and the intersection axis of the circle.
步驟五:經由真正圓檢測,確定鏡頭軸線與待測物表面法線平行。 Step 5: Through the real circle detection, confirm that the lens axis is parallel to the surface normal of the object to be measured.
本發明鏡頭取像演算的實驗例,經過先期實驗結果如下: The experimental example of the lens acquisition calculation of the present invention has the following preliminary experimental results:
實驗例一:觸控曲面正面取像,圖8左側為取樣圖,圖8右側為影像處理後圖。 Experimental example one: Take a picture of the front of the touch curved surface. The left side of FIG. 8 is the sampling image, and the right side of FIG. 8 is the image after image processing.
實驗例二:觸控曲面正面遠距取像,圖9側為取樣圖,圖9右側為影像處理後圖。 Experimental example 2: Long-distance image acquisition on the front of the touch curved surface. The side of FIG. 9 is the sampling image, and the right side of FIG. 9 is the image after image processing.
實驗三:觸控曲面右偏遠距取像,圖10左側為取樣圖,圖10右側為影像處理後圖。 Experiment 3: Right-distance image acquisition of the touch surface. The left side of Fig. 10 is the sampling image, and the right side of Fig. 10 is the image after image processing.
實驗四:觸控曲面右偏取像,圖11左側為取樣圖,圖11右側為影像處理後圖。 Experiment 4: Right-biased capture of the touch surface. The left side of Fig. 11 is the sampling image, and the right side of Fig. 11 is the image after image processing.
實驗五:觸控曲面左偏取像,圖12左側為取樣圖,圖12右側為影像處理後圖。 Experiment 5: The left-handed image of the touch surface is taken. The left side of FIG. 12 is a sampling image, and the right side of FIG. 12 is an image after image processing.
實驗六:觸控曲面凸起取像,圖13左側為取樣圖,圖13右側為影像處理後圖。 Experiment 6: Touch curved convex image acquisition, the left side of Fig. 13 is the sampling image, and the right side of Fig. 13 is the image after image processing.
以上所述,僅為本發明之可行實施例,並非用以限定本發明之專利範圍,凡舉依據下列請求項所述之內容、特徵以及其精神而為之其他變化的等效實施,皆應包含於本發明之專利範圍內。本發明所具體界定於請求項之結構特徵,未見於同類物品,且具實用性與進步性,已符合發明專利要件,爰依法具文提出申請,謹請 鈞局依法核予專利,以維護本申請人合法之權益。 The above is only a feasible embodiment of the present invention and is not intended to limit the patent scope of the present invention. Any equivalent implementation of other changes based on the content, features and spirit described in the following claims should be Included in the patent scope of the present invention. The structural features of the invention specifically defined in the claim are not found in similar items, and are practical and progressive. They have met the requirements of the invention patent. You have filed an application in accordance with the law, and I would like to ask the Jun Bureau to approve the patent in accordance with the law to maintain this. The applicant's legal rights and interests.
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW106119883A TWI633278B (en) | 2017-06-14 | 2017-06-14 | Three-dimensional space touch panel detection system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW106119883A TWI633278B (en) | 2017-06-14 | 2017-06-14 | Three-dimensional space touch panel detection system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI633278B true TWI633278B (en) | 2018-08-21 |
TW201905418A TW201905418A (en) | 2019-02-01 |
Family
ID=63959713
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW106119883A TWI633278B (en) | 2017-06-14 | 2017-06-14 | Three-dimensional space touch panel detection system and method |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI633278B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6111234A (en) * | 1991-05-07 | 2000-08-29 | Batliwalla; Neville S. | Electrical device |
TW201245706A (en) * | 2010-11-15 | 2012-11-16 | Koh Young Tech Inc | Board inspection method |
TWM468673U (en) * | 2013-06-14 | 2013-12-21 | Morga Test Inc | Touch panel inspection device and touch panel inspection system |
-
2017
- 2017-06-14 TW TW106119883A patent/TWI633278B/en not_active IP Right Cessation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6111234A (en) * | 1991-05-07 | 2000-08-29 | Batliwalla; Neville S. | Electrical device |
TW201245706A (en) * | 2010-11-15 | 2012-11-16 | Koh Young Tech Inc | Board inspection method |
TWM468673U (en) * | 2013-06-14 | 2013-12-21 | Morga Test Inc | Touch panel inspection device and touch panel inspection system |
Also Published As
Publication number | Publication date |
---|---|
TW201905418A (en) | 2019-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6865865B2 (en) | Product quality inspection improvement method and system by robot | |
US10383498B2 (en) | Systems and methods to command a robotic cleaning device to move to a dirty region of an area | |
CN104023906B (en) | Operation management device and operation management system | |
JP6960980B2 (en) | Image-based tray alignment and tube slot positioning in visual systems | |
CN207036661U (en) | A kind of Systems for optical inspection based on six-joint robot | |
TWM556842U (en) | Testing device for curved touch panel | |
CN103797446A (en) | Method for detecting motion of input body and input device using same | |
JP2013506209A (en) | Method and apparatus for detecting a gazing point based on face detection and image measurement | |
US20220092757A1 (en) | Grading cosmetic appearance of a test object | |
CN105424726A (en) | Machine vision based light-emitting panel detection method | |
TWI699525B (en) | Three-dimensional phase shift defect detection method and system | |
CN108731602A (en) | Object thickness measurement system, method, detection device and computer program product | |
CN210803323U (en) | Curved surface glass defect detecting system | |
KR20210091189A (en) | Optimization of setup steps in automated visual inspection processes | |
US20170151676A1 (en) | Optical measurement of object location in three dimensions | |
US20170371123A1 (en) | Method and system for multi-lens module alignment | |
TWI585395B (en) | Panel inspection apparatus and method | |
TWI633278B (en) | Three-dimensional space touch panel detection system and method | |
TWI662248B (en) | Detection method and system for three-dimensional touch panel by two-fingers touching | |
CN204405005U (en) | A kind of glass size on-line detecting system | |
US10656097B2 (en) | Apparatus and method for generating operation program of inspection system | |
JP7217911B2 (en) | Contamination inspection system | |
TWI662251B (en) | Three-dimensional linear detection method and system | |
US20170080569A1 (en) | Apparatus, methods, computer programs, and non-transitory computer readable storage mediums for controlling movement of robotic machinery relative to an object | |
CN105653101B (en) | Touch point sensing method and optical touch system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |