TWI616100B - Curved surface projection correction control method and its augmented reality application system - Google Patents

Curved surface projection correction control method and its augmented reality application system Download PDF

Info

Publication number
TWI616100B
TWI616100B TW104144630A TW104144630A TWI616100B TW I616100 B TWI616100 B TW I616100B TW 104144630 A TW104144630 A TW 104144630A TW 104144630 A TW104144630 A TW 104144630A TW I616100 B TWI616100 B TW I616100B
Authority
TW
Taiwan
Prior art keywords
image
projection
curved surface
area
correction
Prior art date
Application number
TW104144630A
Other languages
Chinese (zh)
Other versions
TW201615007A (en
Inventor
賈叢林
沈駿寗
李玟毅
Original Assignee
銘傳大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 銘傳大學 filed Critical 銘傳大學
Priority to TW104144630A priority Critical patent/TWI616100B/en
Publication of TW201615007A publication Critical patent/TW201615007A/en
Application granted granted Critical
Publication of TWI616100B publication Critical patent/TWI616100B/en

Links

Landscapes

  • Controls And Circuits For Display Device (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

本發明係提供一種曲面之投影校正方法,其步驟包含,一投影單元於一投影面投影一校正畫面;一影像擷取單元擷取所述校正畫面,並定義該校正畫面之灰階影像值域,予以二值化成一二值化圖像;將該二值化圖像劃分為背景區域及投影區域;定義所述投影區域內之平行四邊形範圍為轉換區域,並由該轉換區域界定校正參數以對應校正該投影單元投影之影像;藉之,本發明可校正該投影單元所投影之影像,防止影像扭曲變形,並能因應各式形狀之投影面,如:牆壁轉角、天花板接縫或曲面之投影面,皆能正確投影該影像,且本發明可掛設於使用者胸前,利於攜帶,俾具便利性及廣泛適用性之功效者。 The present invention provides a projection correction method for a curved surface, the method comprising: a projection unit projecting a correction image on a projection surface; an image capture unit capturing the correction image and defining a grayscale image range of the correction image Binarizing into a binarized image; dividing the binarized image into a background region and a projection region; defining a parallelogram range in the projection region as a conversion region, and defining a correction parameter by the conversion region Corresponding to correcting the image projected by the projection unit; thereby, the invention can correct the image projected by the projection unit, prevent the image from being distorted, and can conform to various projection surfaces, such as wall corners, ceiling seams or curved surfaces. The projection surface can correctly project the image, and the invention can be hung on the chest of the user, which is convenient for carrying, the convenience of the cookware and the universal applicability.

Description

曲面之投影校正控制方法及其擴增實境應用系統 Projection correction control method for curved surface and its augmented reality application system

本發明係提供曲面之投影校正控制方法及其擴增實境應用系統,尤指一種能因應各式形狀之投影面,予以校正投影之影像者。 The invention provides a projection correction control method for a curved surface and an augmented reality application system thereof, in particular, an image capable of correcting projection according to a projection surface of various shapes.

按,於數位世界中的物體或資訊進行操縱和互動的技術,在虛擬實境(Virtual Reality,VR)領域的研究中已有許多的成果,其中對於資訊的呈現,主要是透過頭戴式顯示器滿足觀察者即時的需求,但人們對於電腦科技應用的真正需求並非是電腦所模擬出的數位世界,或感受虛擬世界中的物體或環境,更核心的需要是如何在真實世界中提供數位資訊,讓人們仍感覺是在真實世界中,而非去適應虛擬世界,這使得擴增實境(Augmented Reality,AR)應運而生。 According to the technology of manipulating and interacting with objects or information in the digital world, there have been many achievements in the field of virtual reality (VR), in which the presentation of information is mainly through head-mounted displays. To meet the immediate needs of observers, but the real need for computer technology applications is not the digital world simulated by computers, or the objects or environments in the virtual world. The core need is how to provide digital information in the real world. Let people still feel that they are in the real world, not to adapt to the virtual world, which makes Augmented Reality (AR) come into being.

雖然在虛擬實境領域中的大多數技術,都能直接應用於擴增實境的應用中,但其中如何將真實世界與數位世界作正確的結合,則是其中最主要的技術差異,如:透過觀察者的姿態決定虛擬物體的配合姿態;於真實世界的物體上投射對應的數位資訊等,都涉及上述的技術主題,人類的資訊接收來源主要是透過視覺、聽覺、嗅覺、味覺與觸覺等身體知覺感受器進行接收,其中視覺囊括了身體知覺感受器總量的百分之七十,因此透過影像取得資訊,是人類最主要與方便的方式,再者,由於人類對於視覺品質之要求也最為敏感,因 此一個理想的擴張實境應用系統,需要高品質的顯示能力,才能征服使用者的視覺滿意度。 Although most of the technologies in the virtual reality field can be directly applied to augmented reality applications, how to correctly combine the real world and the digital world is the most important technical difference, such as: The posture of the virtual object is determined by the observer's posture; the corresponding digital information is projected on the real world object, etc., all of which involve the above technical topics. The source of human information is mainly through visual, auditory, olfactory, taste and touch. Body sensory receptors are received, in which the visual capsule contains 70% of the total body sensory receptors. Therefore, obtaining information through images is the most important and convenient way for human beings. Moreover, human beings are most sensitive to visual quality requirements. ,because This ideal expansion application system requires high-quality display capabilities to conquer the visual satisfaction of users.

在虛擬實境的應用中,係使用頭戴式顯示器(頭盔型或眼鏡型)而獲得資訊,讓資訊的顯示變得簡單,而不含有技術門檻,但這也讓虛擬實境的應用範疇,與實際世界隔離,限制它與日常生活的關聯性,因此主要的用途皆以模擬訓練為主,惟科技使終來自生活與人性需求,要將虛擬實境技術應用於日常生活,明顯會讓資訊的顯示成為技術的門檻,由於需要滿足人們的活動需求,就無法將人們局限在傳統電腦螢幕之前,要將資訊顯示於環境中,因此,需研究開發一種能讓使用者直接在生活環境中顯示所需資訊需求,成為要發展擴增實境應用平台首要解決的問題。 In virtual reality applications, head-mounted displays (helmet-type or glasses-type) are used to obtain information, making information display simpler without technical thresholds, but it also allows for virtual reality applications. It is isolated from the real world and limits its relevance to daily life. Therefore, the main uses are mainly simulation training. However, technology will ultimately come from life and human needs. It is necessary to apply virtual reality technology to daily life, which will obviously make information The display becomes the threshold of technology. Because it needs to meet the needs of people's activities, it is impossible to limit people to the traditional computer screens, and to display information in the environment. Therefore, it is necessary to research and develop a kind of display that allows users to display directly in the living environment. The required information needs have become the primary problem to be solved in the development of augmented reality application platforms.

擴增實境係利用實地計算攝影機影像的位置及角度,並透過影像呈現之技術,其應用層面極為廣泛,可應用於衛星、行動設備、手術醫療、工業及娛樂等技術領域,惟,習用之擴增實境平台,呈現於自行攜帶螢幕(如:智慧型手機、平板電腦、或電腦螢幕),或使用投影機投影至所需的位置。 Augmented Reality uses the technology to calculate the position and angle of camera images in the field, and through the technology of image presentation, it has a wide range of applications, and can be applied to satellite, mobile devices, surgical medical, industrial and entertainment technologies, but it is used. Augmented reality platform, presented on your own portable screen (such as: smart phone, tablet, or computer screen), or projected to the desired location using the projector.

惟此,攜帶式螢幕無法產生足夠之擴增實境呈現範圍,故難以與實際影像結合;使用投影機投影者,雖拜微型化科技之賜,發展出微型投影機,使其輕巧易於攜帶,能滿足個人使用時的顯示範圍,但仍需要透過投影面反射影像,故具有投影面幾何扭曲之問題,而利用高階的攝影器材拍攝投影範圍,其投影範圍可以為任意不規則的牆面、牆角、雙窗簾、磚牆等,並且利用高階攝影器材所拍攝投影範圍,對每個像素的變化來做校正,其於理論上雖可以校正任何投影面,但是卻需要很高階的攝影器材才可完成校正,其需耗費大量之成本,且若僅能產生習用投影機般的統一大小或標準之矩形顯示範圍,將導致擴增實境資訊失去真實感,降低其適用性。 However, the portable screen cannot produce enough abundance of real-world presentation, so it is difficult to combine with the actual image. With the projector projector, thanks to the miniaturization technology, the micro-projector has been developed to make it light and easy to carry. It can meet the display range of personal use, but still needs to reflect the image through the projection surface, so it has the problem of geometric distortion of the projection surface, and the projection range can be taken by high-order photographic equipment, and the projection range can be any irregular wall and corner. , double curtains, brick walls, etc., and use the high-end photographic equipment to shoot the projection range, to correct the change of each pixel, in theory, although it can correct any projection surface, but it requires high-order photographic equipment to complete Correction, which requires a lot of cost, and if it can only produce a uniform size or standard rectangular display range like a conventional projector, it will cause the augmented reality information to lose its realism and reduce its applicability.

有鑑於此,吾等發明人乃潛心進一步研究投影校正方法及擴增實 境應用系統,並著手進行研發及改良,期以一較佳設作以解決上述問題,且在經過不斷試驗及修改後而有本發明之問世。 In view of this, our inventors are concentrating on further research on projection correction methods and amplification. The application system, and the development and improvement of the system, is designed to solve the above problems, and the invention has been continuously tested and modified.

緣是,本發明之目的係為解決習用攜帶式螢幕無法產生足夠之擴增實境呈現範圍,故難以與實際影像結合;透過投影機投射者,則常有投影面幾何扭曲之問題,需利用高階的攝影器材拍攝投影範圍,其需耗費大量之成本,且僅能產生習用投影機般的統一大小或標準之矩形顯示範圍,將導致擴增實境資訊失去真實感,降低其適用性。 The reason is that the purpose of the present invention is to solve the problem that the portable portable screen cannot generate sufficient abundance of reality, so it is difficult to combine with the actual image; if the projector is projected through the projector, the geometric distortion of the projection surface often needs to be utilized. High-end photographic equipment shoots a range of projections, which requires a large amount of cost, and can only produce a uniform size or a standard rectangular display range like a conventional projector, which will result in the loss of realism and reduce the applicability of the augmented reality information.

為達致以上目的,吾等發明人提供一種曲面之投影校正方法,其步驟包含:(a)一投影單元於一投影面投影一第一曲面校正畫面,並由該影像擷取單元擷取該第一曲面校正畫面;(b)該投影單元投影一對應該於第一曲面校正畫面成形網格之第二曲面校正畫面,該影像擷取單元擷取該第二曲面校正畫面,並定義該第一曲面校正畫面及第二曲面校正畫面之灰階影像值域,予以二值化成一二值化圖像;(c)將該二值化圖像細線化成一細線化圖像,並定義於該細線化圖像中,該第一曲面校正畫面及第二曲面校正畫面具有交點而形成所述之網格者,則該投影面為曲面;並將該二值化圖像劃分為背景區域及投影區域;以及,(d)定義所述投影區域內之平行四邊形範圍為轉換區域,並由該轉換區域界定校正參數以對應校正該投影單元投影之影像者。 In order to achieve the above object, the inventors provide a projection correction method for a curved surface, the method comprising: (a) a projection unit projecting a first curved surface correction image on a projection surface, and the image capturing unit captures the image a first surface correction picture; (b) the projection unit projects a pair of second surface correction pictures that should be formed on the first surface correction picture forming grid, the image capturing unit captures the second surface correction picture, and defines the first a gray scale image value field of a curved surface correction picture and a second curved surface correction picture is binarized into a binary image; (c) thinning the binary image into a thin line image, and is defined in the In the thinned image, if the first curved surface correction image and the second curved surface corrected image have intersection points to form the mesh, the projection surface is a curved surface; and the binarized image is divided into a background region and a projection. And (d) defining a range of parallelograms within the projection area as a transition region, and defining a correction parameter by the transition region to correspond to correcting an image of the projection of the projection unit.

據上所述之投影校正方法,其步驟更進一步包含: (e)於該細線化圖像內定義一基準線,以判定所述網格之複數座標點;以及,(f)定義該等座標點所形成之區域為所述之投影區域。 According to the projection correction method described above, the steps further include: (e) defining a reference line within the thinned image to determine a plurality of coordinate points of the grid; and (f) defining an area formed by the coordinate points as the projected area.

本發明另提供一種投影控制方法,其包含如前述之投影校正方法。 The present invention further provides a projection control method comprising the projection correction method as described above.

據上所述之投影控制方法,其步驟更進一步包含:(g)該影像擷取單元擷取一手部影像;(h)將該手部影像二值化為手部二值化圖像,並透過使用者自定義劃分為膚色區域及非膚色區域;(i)建立一訓練資料庫,其儲存並依所述膚色區域定義每一顏色之機率值,以及界定一膚色門檻值;(j)判定機率值大於該膚色門檻值之顏色為膚色值,並依所述膚色值形成一手部區域;以及,(k)於手部區域面積大於一面積定值並持續一時間定值後,控制啟閉所述之投影單元。 According to the projection control method described above, the method further comprises: (g) capturing, by the image capturing unit, a hand image; (h) binarizing the hand image into a hand binarized image, and (i) establishing a training database that stores and defines a probability value for each color according to the skin color region and defines a skin color threshold value; (j) determining The color whose probability value is greater than the color threshold value is the skin color value, and forms a hand region according to the skin color value; and (k) after the hand region area is greater than a certain area value and continues to be fixed for a time, the control is opened and closed. The projection unit.

據上所述之投影控制方法,其步驟更進一步包含:(l)該影像擷取單元擷取環境光度;以及,(m)定義一光度門檻值,並於環境光度小於該光度門檻值時啟動所述之投影單元。 According to the projection control method described above, the method further comprises: (1) the image capturing unit extracts ambient luminosity; and (m) defines a luminosity threshold value, and starts when the ambient luminosity is less than the photometric threshold value; The projection unit.

本發明另提供一種擴增實境應用系統,其包含:一投影單元,其對應投影一第一曲面校正畫面及一對應該於第一曲面校正畫面成形網格之第二曲面校正畫面於一投影面;一影像擷取單元,其對應擷取該投影面呈現之該第一曲面校正畫面及該第二曲面校正畫面;以及,一處理單元,其耦接於該投影單元及該影像擷取單元,該處理單元係辨識該校正畫面所成像之投影面,並分 析該第一曲面校正畫面及第二曲面校正畫面之灰階影像值域,予以二值化成一二值化圖像,並將該二值化圖像細線化成一細線化圖像,並定義於該細線化圖像中,該第一曲面校正畫面及第二曲面校正畫面具有交點而形成所述之網格者,則該投影面為曲面,並定義所述網格所形成之區域為投影區域,再於該投影區域內搜尋平行四邊形範圍者為轉換區域,透過該轉換區域校正該投影單元對應投影於該投影面之影像者。 The present invention further provides an augmented reality application system, comprising: a projection unit corresponding to projecting a first curved surface correction picture and a pair of second curved surface correction pictures that should be formed on the first curved surface correction picture forming mesh An image capturing unit corresponding to the first curved surface corrected image and the second curved surface corrected image; and a processing unit coupled to the projection unit and the image capturing unit The processing unit identifies the projection surface imaged by the correction picture, and divides Parsing the grayscale image value range of the first curved surface correction picture and the second curved surface correction picture, binarizing into a binary image, and thinning the binary image into a thinned image, and defining In the thinned image, if the first curved surface correction image and the second curved surface corrected image have intersection points to form the mesh, the projection surface is a curved surface, and the area formed by the mesh is defined as a projection area. And searching for the parallelogram range in the projection area as a conversion area, and correcting the projection unit corresponding to the image projected on the projection surface through the conversion area.

據上所述之擴增實境應用系統,更進一步包含一反射單元,其對應設於該投影單元,藉以調整該投影單元投影之角度。 According to the augmented reality application system described above, a reflection unit is further included, which is correspondingly disposed on the projection unit, thereby adjusting the angle of projection of the projection unit.

據上所述之擴增實境應用系統,其中,該投影單元係投影擴增實境之影像。 According to the augmented reality application system described above, the projection unit is a projection image of the augmented reality.

據上所述之擴增實境應用系統,其中,該影像擷取單元更進一步擷取手部影像,該處理單元係依膚色值辨識為手部區域,且該處理單元設有一面積定值及一時間定值,並於該手部區域之面積大於一定值且持續至該時間定值時,操控啟閉該投影單元。 According to the augmented reality application system described above, the image capturing unit further extracts a hand image, the processing unit is identified as a hand region according to a skin color value, and the processing unit is provided with an area setting value and a The time is set, and when the area of the hand area is greater than a certain value and continues to the time value, the projection unit is turned on and off.

據上所述之擴增實境應用系統,其中,該影像擷取單元更進一步擷取環境光度,該處理單元設有一光度門檻值,並於環境光度小於該光度門檻值時啟動所述之投影單元。 According to the augmented reality application system described above, wherein the image capturing unit further extracts ambient luminosity, the processing unit is provided with a luminosity threshold value, and the projection is started when the ambient luminosity is less than the luminosity threshold value. unit.

藉由上述設置,本發明可以讓數位資訊顯示於現實世界中,讓獲取資訊的方式更貼近生活,並解決習用擴增實境將投影資訊投影於現實世界中,具有成本高昂、不利於攜帶及投影幾何扭曲等缺失,本發明係可讓使用者無負擔地掛在胸前,且可手動操作反射單元,藉以調整投影單元成像之高度,而調整投影高度或因各式形狀之投影面,將易導致影像扭曲變形,故本發明係透過該投影單元投影校正畫面,由影像擷取單元擷取校正畫面於各式形狀之投影面,如單一平面、雙平面及曲面,並予以校正該投影單元投射之影像,顯見 本發明讓使用者可以隨時隨地尋找投影面而投影,如:牆壁轉角、天花板接縫、球型拱門等,或因深度不同平面所產生的投影變形,如:窗簾、牆壁、柱子等,本發明皆能因應克服,並投影正確之影像;再者,本發明考量使用之便利性,可透過膚色偵測後界定出手部區域之面積,於達所述面積定值及時間定值時,以啟閉該投影單元,亦可透過該影像擷取單元一環境光度而自動開啟該投影單元,避免電力耗損,同時提升本發明於使用上之便利性及廣泛之適用性者。 With the above arrangement, the present invention can display digital information in the real world, make the information acquisition method closer to life, and solve the problem of using the augmented reality to project the projection information into the real world, which is costly and unfavorable for carrying and The invention is designed to allow the user to hang on the chest without burden, and the reflective unit can be manually operated to adjust the height of the projection unit and adjust the projection height or the projection surface of various shapes. The invention is characterized in that the image is distorted and deformed. Therefore, the present invention projects the correction image through the projection unit, and the image capturing unit captures the projection surface of the correction image on various shapes, such as a single plane, a double plane, and a curved surface, and corrects the projection unit. Projected image, obvious The invention allows the user to search for the projection surface anytime and anywhere, such as: wall corners, ceiling seams, ball arches, etc., or projection deformation due to different depths of the plane, such as: curtains, walls, columns, etc., the present invention The invention can overcome the problem and project the correct image; furthermore, the invention considers the convenience of use, and can define the area of the hand region after detecting the skin color, and when the value of the area is determined and the time is fixed, By closing the projection unit, the projection unit can be automatically turned on by the image capturing unit to reduce the power consumption, and the convenience and wide applicability of the present invention can be improved.

1‧‧‧投影單元 1‧‧‧projection unit

11‧‧‧校正畫面 11‧‧‧Correction screen

2‧‧‧投影面 2‧‧‧Projection surface

3‧‧‧影像擷取單元 3‧‧‧Image capture unit

4‧‧‧二值化圖像 4‧‧‧ binarized image

41‧‧‧背景區域 41‧‧‧Background area

42‧‧‧投影區域 42‧‧‧Projection area

421‧‧‧邊緣 Edge of 421‧‧

422‧‧‧直線 422‧‧‧ Straight line

423‧‧‧邊緣線 423‧‧‧ edge line

424‧‧‧面域 424‧‧‧ Faces

43‧‧‧轉換區域 43‧‧‧Conversion area

44、44a、44b‧‧‧區域角點 44, 44a, 44b‧‧‧ regional corner points

45a、45b‧‧‧轉換點 45a, 45b‧‧‧ conversion point

46‧‧‧鄰接線 46‧‧‧ Adjacent lines

5‧‧‧手部影像 5‧‧‧Hand image

51‧‧‧手部二值化圖像 51‧‧‧Hand binarized image

52‧‧‧膚色區域 52‧‧‧ skin color area

53‧‧‧非膚色區域 53‧‧‧Non-skin area

6‧‧‧反射單元 6‧‧‧Reflective unit

7‧‧‧第一曲面校正畫面 7‧‧‧First surface correction screen

71‧‧‧縱向線 71‧‧‧Longitudinal line

8‧‧‧第二曲面校正畫面 8‧‧‧Second surface correction screen

81‧‧‧橫向線 81‧‧‧ horizontal line

9‧‧‧細線化圖像 9‧‧‧ Thin line image

91‧‧‧基準線 91‧‧‧ baseline

92‧‧‧座標點 92‧‧‧Punctuation

第1圖 係本發明之結構示意圖。 Figure 1 is a schematic view of the structure of the present invention.

第2圖 係本發明第一實施例之流程示意圖。 Fig. 2 is a flow chart showing the first embodiment of the present invention.

第3圖 係本發明第一實施例之二值化圖像示意圖。 Figure 3 is a schematic diagram of a binarized image of the first embodiment of the present invention.

第4圖 係本發明第一實施例之邊緣偵測示意圖。 Figure 4 is a schematic diagram of edge detection in the first embodiment of the present invention.

第5圖 係本發明第一實施例之霍夫轉換示意圖。 Fig. 5 is a schematic diagram showing the Hough conversion of the first embodiment of the present invention.

第6圖 係本發明第一實施例之直線過濾示意圖。 Fig. 6 is a schematic view showing the linear filtration of the first embodiment of the present invention.

第7圖 係本發明第一實施例之定義轉換區域示意圖。 Figure 7 is a schematic view showing the definition of the conversion area of the first embodiment of the present invention.

第8圖 係本發明第一實施例之轉換校正投影單元投影影像之示意圖。 Figure 8 is a schematic view showing a projection image of a conversion correcting projection unit of the first embodiment of the present invention.

第9圖 係本發明第一實施例影像擷取單元擷取手部圖像之示意圖。 Figure 9 is a schematic diagram of the image capture unit of the first embodiment of the present invention.

第10圖 係本發明第一實施例手部二值化圖像之示意圖。 Figure 10 is a schematic view showing a hand binarized image of the first embodiment of the present invention.

第11圖 係本發明第二實施例之流程示意圖。 Figure 11 is a flow chart showing the second embodiment of the present invention.

第12圖 係本發明第二實施例之二值化圖像示意圖。 Figure 12 is a schematic diagram of a binarized image of a second embodiment of the present invention.

第13圖 係本發明第二實施例之邊緣偵測示意圖。 Figure 13 is a schematic diagram of edge detection in accordance with a second embodiment of the present invention.

第14圖 係本發明第二實施例之霍夫轉換示意圖。 Fig. 14 is a schematic diagram showing the Hough conversion of the second embodiment of the present invention.

第15圖 係本發明第二實施例之直線過濾示意圖。 Fig. 15 is a schematic view showing the linear filtration of the second embodiment of the present invention.

第16圖 係本發明第二實施例之定義轉換區域示意圖。 Figure 16 is a schematic view showing the definition of the conversion area of the second embodiment of the present invention.

第17圖 係本發明第二實施例之鄰接線之示意圖。 Figure 17 is a schematic view showing the adjacent line of the second embodiment of the present invention.

第18圖 係本發明第二實施例鄰接線畫分面域之示意圖。 Figure 18 is a schematic view showing a second embodiment of the present invention adjacent to a line drawing sub-area.

第19圖 係本發明第二實施例左邊之面域轉換校正投影單元投影影像之示意圖。 Figure 19 is a schematic view showing a projection image of a projection conversion unit of the left side of the second embodiment of the present invention.

第20圖 係本發明第二實施例右邊之面域轉換校正投影單元投影影像之示意圖。 Figure 20 is a schematic diagram of a projection image of a field conversion correction projection unit on the right side of the second embodiment of the present invention.

第21圖 係本發明第三實施例之流程示意圖。 Figure 21 is a flow chart showing the third embodiment of the present invention.

第22圖 係本發明第三實施例之第一曲面校正畫面示意圖。 Figure 22 is a schematic diagram of a first curved surface correction screen of a third embodiment of the present invention.

第23圖 係本發明第三實施例之第二曲面校正畫面示意圖。 Figure 23 is a schematic view showing a second curved surface correction screen of the third embodiment of the present invention.

第24圖 係本發明第三實施例之二值化圖像細線化為細線化圖像之示意圖。 Fig. 24 is a schematic view showing the thinning of the binarized image of the third embodiment of the present invention into a thinned image.

第25圖 係本發明第三實施例基準線定義座標點之示意圖。 Figure 25 is a schematic view showing the definition of coordinate points of the reference line of the third embodiment of the present invention.

第26圖 係本發明第三實施例座標點形成投影區域之示意圖。 Figure 26 is a schematic view showing the formation of a projection area by the coordinate points of the third embodiment of the present invention.

第27圖 係本發明第三實施例之轉換區域之示意圖。 Figure 27 is a schematic view showing a conversion area of a third embodiment of the present invention.

關於吾等發明人之技術手段,茲舉數種較佳實施例配合圖式於下文進行詳細說明,俾供 鈞上深入了解並認同本發明。 The invention will be described in detail below with reference to the drawings.

請先參閱第1圖至第10圖所示,其係本發明之第一實施例,本發明係一種擴增實境應用系統,其包含:一投影單元1,其對應投影一校正畫面11於一投影面2,該投影單元1係投影擴增實境之影像,且該投影面2為單一平面、雙平面或曲面;一影像擷取單元3,其對應擷取該投影面2呈現之影像;一處理單元,其耦接於該投影單元1及該影像擷取單元3,該處理單元係辨識該校正畫面11所成像之投影面2,並分析該校正畫面11之灰階影像值 域,予以二值化成一二值化圖像4,將該二值化圖4像化分為背景區域41及投影區域42,再於該投影區域42內搜尋平行四邊形範圍者為轉換區域43,透過該轉換區域43校正該投影單元1對應投影於該投影面2之影像者,該影像擷取單元3擷取手部影像5,該處理單元係依膚色值辨識為手部區域,且該處理單元設有一面積定值及一時間定值,並於該手部區域之面積大於一定值且持續至該時間定值時,操控啟閉該投影單元1;該影像擷取單元3更擷取環境光度,該處理單元設有一光度門檻值,並於環境光度小於該光度門檻值時啟動所述之投影單元1;以及,一反射單元6,其對應設於該投影單元1,藉以調整該投影單元1投影之角度。 Please refer to FIG. 1 to FIG. 10 , which is a first embodiment of the present invention. The present invention is an augmented reality application system, comprising: a projection unit 1 corresponding to projecting a correction picture 11 a projection surface 2, the projection unit 1 is a projection image of the augmented reality, and the projection surface 2 is a single plane, a double plane or a curved surface; an image capturing unit 3 corresponding to the image captured by the projection surface 2 A processing unit is coupled to the projection unit 1 and the image capturing unit 3, the processing unit identifies the projection surface 2 imaged by the correction screen 11, and analyzes the grayscale image value of the correction screen 11. The domain is binarized into a binarized image 4, and the binarized image 4 is imaged into a background region 41 and a projection region 42, and the region of the parallelogram is searched for the transition region 43 in the projection region 42. Correcting the image of the projection unit 1 corresponding to the projection surface 2 through the conversion area 43 , the image capturing unit 3 captures the hand image 5 , the processing unit is identified as the hand area according to the skin color value, and the processing unit An area setting value and a time setting value are provided, and when the area of the hand area is greater than a certain value and continues to the time value, the projection unit 1 is controlled to be turned on and off; the image capturing unit 3 takes an ambient luminosity The processing unit is provided with a illuminance threshold value, and the projection unit 1 is activated when the ambient luminosity is less than the luminosity threshold value; and a reflection unit 6 correspondingly disposed on the projection unit 1 to adjust the projection unit 1 The angle of the projection.

續請參閱第1圖至第10圖所示,本發明提供一種曲面之投影校正方法,其步驟包含:一投影單元1於一投影面2投影一校正畫面11;一影像擷取單元3擷取所述校正畫面11,假設影像擷取單元3之色彩空間為三原色(RGB),則定義影像擷取單元3擷取之校正畫面11為IC(xc,yc){R,G,B},並定義該校正畫面11之灰階影像值域為[0,255],並設定灰階化之校正畫面11為ICg(xcg,ycg),得ICg(xcg,ycg)[0,255],如第3圖及第4圖所示,而後予以二值化成一二值化圖像4,藉以將該二值化圖像4劃分為背景區域41及投影區域42,並定義該二值化圖像4為ICb(xcb,ycb){0,1};於將該二值化圖像4偵測該投影區域42之邊緣421,得該二值化圖像4之邊緣影像為ICe(xce,yce){0,1},並如第5圖及第6圖所示,以霍夫轉換定義形成該邊緣421之複數直線422,而其將造成邊緣421偵測之誤判,故將該等直線422以冗餘直線過濾,界定形成該投影區域42邊緣421之邊緣線423,且定義所述之邊緣線423係形成四個區域角點44者,則該投影面2為單一平面; 界定由所述邊緣線423相交形成之區域角點44,如第4圖所示,可求得該區域角點44之座標,並判定所述區域角點44所圍繞之區域,為該投影區42域之座標方程式;定義所述投影區域之座標方程式內之平行四邊形範圍為轉換區域43,舉例而言,請參閱第7圖所示,該投影區42為一四邊形,所述區域角點44為該四邊形之頂點,而所述邊緣線423為四邊形之邊,由上端其一之區域角點44a朝y軸方向投影至該邊緣線423a之對邊而形成轉換點45a,而另一上端之區域角點44b則對應邊緣線423a之斜率,對應轉換點45a而形成轉換點45b,藉以定義由區域角點44a、44b及轉換點45a、45b形成之平行四邊形為轉換區域43;次請參閱第8圖之左上圖所示,其為該投影單元1內校正前預覽投影之畫面,假設其座標點分別為I0(0,0)、I1(iX-1,0)、I2(iX-1,iY-1)及I3(0,iY-1),其於該投影面2投影之結果,如第8圖之右上圖所示,其係該影像擷取單元3所擷取之影像,使該校正畫面11之座標點分別為P0(x0,y0)、P1(x1,y1)、P2(x2,y2)及P3(x3,y3),定義點I0、I1、I2、I3及點P0、P1、P2、P3之轉換關係為{P0,P1,P2,P3}=T1{I0,I1,I2,I3},藉以搜尋該投影單元1對於該投影面2投影該校正畫面11造成扭曲變形之函數,而如第8圖之右下圖所示,該轉換區域43之座標點分別為PI0(xpi0,ypi0)、P1(xpi1,ypi1)、P2(xpi2,ypi2)及P3(xpi3,ypi3),而該校正畫面11及所述轉換區域43之轉換關係為{PI0,PI1,PI2,PI3}=T2{P0,P1,P2,P3},並藉由T1及T2反推轉換該投影單元1校正後預覽投影之畫面,故得一校正參數,將該投影單元1校正後預覽投影之畫面之座標點分別為PT0(PTx0,PTy0)、P1(PTx1,PTy1)、P2(PTx2,PTy2)及P3(PTx3,PTy3),如第8圖之左下圖所示,對應校正該投影單元1投影之影像者。 Continuing to refer to FIG. 1 to FIG. 10, the present invention provides a projection correction method for a curved surface, the method comprising: a projection unit 1 projecting a correction image 11 on a projection surface 2; an image capture unit 3 captures The correction screen 11 assumes that the color space of the image capturing unit 3 is the three primary colors (RGB), and the corrected picture 11 captured by the image capturing unit 3 is defined as IC(x c , y c ). {R, G, B}, and define the grayscale image range of the correction screen 11 as [0, 255], and set the grayscale correction screen 11 to ICg (x cg , y cg ) to obtain ICg (x cg , y cg ) [0, 255], as shown in FIGS. 3 and 4, and then binarized into a binarized image 4, thereby dividing the binarized image 4 into a background region 41 and a projection region 42, and defining the Binarized image 4 is ICb (x cb , y cb ) {0,1}; detecting the edge 421 of the projection area 42 in the binarized image 4, and obtaining an edge image of the binarized image 4 as ICe(x ce , y ce ) {0, 1}, and as shown in Figures 5 and 6, the complex line 422 of the edge 421 is formed by the Hough transform definition, which will cause a misjudgment of the edge 421 detection, so the line 422 is Redundant linear filtering, defining an edge line 423 forming the edge 421 of the projection area 42, and defining the edge line 423 to form four regional corner points 44, the projection surface 2 is a single plane; defined by the edge The line corners 44 intersect at the intersection of the line 423. As shown in FIG. 4, the coordinates of the corner point 44 of the area can be obtained, and the area surrounded by the corner point 44 of the area is determined, which is the coordinate equation of the area of the projection area 42. The range of the parallelogram defining the coordinate equation of the projection area is the conversion area 43. For example, as shown in FIG. 7, the projection area 42 is a quadrilateral, and the corner point 44 of the area is the apex of the quadrilateral The edge line 423 is a quadrilateral edge, and a corner point 44a of the upper end is projected toward the y-axis direction to the opposite side of the edge line 423a to form a transition point 45a, and the corner point 44b of the other upper end is formed. Corresponding to the slope of the edge line 423a, corresponding to the transition point 45a The change point 45b is used to define the parallelogram formed by the area corner points 44a, 44b and the conversion points 45a, 45b as the conversion area 43; the second is shown in the upper left diagram of Fig. 8, which is the preview before the correction in the projection unit 1. The projected picture assumes that its coordinate points are I 0 (0,0), I 1 (iX-1,0), I 2 (iX-1,iY-1), and I 3 (0,iY-1), The result of the projection on the projection surface 2 is as shown in the upper right diagram of FIG. 8, which is the image captured by the image capturing unit 3, so that the coordinate points of the correction screen 11 are respectively P 0 (x 0 , y 0 ), P 1 (x 1 , y 1 ), P 2 (x 2 , y 2 ), and P 3 (x 3 , y 3 ), defining points I 0 , I 1 , I 2 , I 3 , and point P 0, P 1, P 2, P converter 3 the relationship {P 0, P 1, P 2, P 3} = T 1 {I 0, I 1, I 2, I 3}, so as to search for the projection unit 1 For the projection surface 2, the correction picture 11 is projected as a function of distortion, and as shown in the lower right diagram of FIG. 8, the coordinate points of the conversion area 43 are PI 0 (xpi 0 , ypi 0 ), P 1 ( Xpi 1 , ypi 1 ), P 2 (xpi 2 , ypi 2 ) and P 3 (xpi 3 , ypi 3 ), and the conversion relationship between the correction picture 11 and the conversion area 43 is {PI 0 , PI 1 , PI 2 , PI 3 }=T 2 {P 0 , P 1 , P 2 , P 3 }, and by T 1 and T 2 inversely convert the projection unit 1 to correct the preview projection image, thus obtaining a correction parameter The coordinate points of the screen for previewing the projected projection unit 1 are PT 0 (PTx 0 , PTy 0 ), P 1 (PTx 1 , PTy 1 ), P 2 (PTx 2 , PTy 2 ), and P 3 ( PTx 3 , PTy 3 ), as shown in the lower left diagram of FIG. 8 , corresponds to the image of the projection of the projection unit 1 .

續請參閱第9圖及第10圖所示,本實施例係提供一種投影控制方法,其步驟包含: 該影像擷取單元3擷取一手部影像5;本發明係利用YCbCr色彩空間作為顏色之表示形式,藉以配合應用場景與環境照明之變化,而RGB色彩空間並無將色彩及亮度分離之特性,故由該影像擷取單元3所擷取之手部影像,需先將RGB色彩空間轉換為YCbCr色彩空間,其轉換式如下所示: Continuing to refer to FIG. 9 and FIG. 10, the present embodiment provides a projection control method, the method comprising: the image capturing unit 3 captures a hand image 5; the present invention utilizes a YCbCr color space as a color. The representation is used to match the changes of the application scene and the ambient lighting, and the RGB color space has no separation of color and brightness. Therefore, the hand image captured by the image capturing unit 3 needs to first convert the RGB color space. For the YCbCr color space, the conversion is as follows:

為求正確之膚色判斷,故需於該處理單元建立一訓練資料庫,以進行膚色判定之學習,故首先將該手部影像5二值化為手部二值化圖像51,並透過使用者自定義劃分為膚色區域52及非膚色區域53;於訓練資料庫內儲存並依所述膚色區域52定義每一顏色之機率值,以及界定一膚色門檻值,判定機率值大於該膚色門檻值之顏色為膚色值,並依所述膚色值形成一手部區域;手部區域於該影像擷取單元3畫面之面積大於一面積定值並持續一時間定值後,例如:使用者將手部置於該影像擷取單元3前約二秒,該處理單元即控制啟閉所述之投影單元1;該影像擷取單元3更進一步擷取環境光度;以及,該處理單元定義一光度門檻值,並於環境光度小於該光度門檻值時啟動所述之投影單元1。 In order to determine the correct skin color, it is necessary to establish a training database in the processing unit for learning the skin color determination. Therefore, the hand image 5 is first binarized into the hand binarized image 51, and is used. The user is customized to be divided into a skin color region 52 and a non-skin color region 53; stored in the training database and defining a probability value of each color according to the skin color region 52, and defining a skin color threshold value, determining that the probability value is greater than the skin color threshold value The color is a skin color value, and a hand region is formed according to the skin color value; the area of the hand region of the image capturing unit 3 is larger than a certain area value and continues to be fixed for a time, for example, the user puts the hand About two seconds before the image capturing unit 3 is placed, the processing unit controls the opening and closing of the projection unit 1; the image capturing unit 3 further extracts ambient luminosity; and the processing unit defines a luminosity threshold And the projection unit 1 is activated when the ambient luminosity is less than the luminosity threshold.

再請參閱第11圖至第20圖所示,其係本發明之第二實施例,其與第一實施例之差別在於,定義六條所述之邊緣線423,且界定所述邊緣線423於極座標中形成三對夾角近似者,則該投影面為雙平面,如:牆壁之轉角或天花板之接縫處者,且所述邊緣線423相交並包覆該投影區域42之外輪廓定義六個所述之區域角點44; 如第16圖所示,於該邊緣線423內界定一相切於內角最大之區域角點44之水平線L1,並於由該水平線L1之中點P0延伸一交於該邊緣線423之垂直線L2,並由水平線L1及垂直線L2之交點,分別與邊緣線423之距離定義形成三基準點P1、P2、P3,判定一基準矩形為以水平線L1上之二所述基準點P1、P2為底邊長度,而以水平線L1及垂直線L2之交點,及垂直線L2上所述基準點P3之間距為高;界定所述基準矩形延該交點,等比例放大至該基準矩形之任一頂點交於該邊緣線423時為所述轉換區域43;請參閱第17圖至第20圖所示,定義由所述內角最大之區域角點44與其相對之區域角點44形成之直線為鄰接線46,並界定由該鄰接線46將該投影區域42劃分形成二相異之面域424,並分別於所述面域424之區域角點44所圍繞區域內之平行四邊形範圍為所述轉換區域43,其轉換方式與第一實施例雷同,故在此不予贅述。 Referring again to FIGS. 11 to 20, which is a second embodiment of the present invention, which differs from the first embodiment in that six of said edge lines 423 are defined and said edge line 423 is defined. If three pairs of angle approximations are formed in the polar coordinates, the projection surface is a double plane, such as a corner of a wall or a seam of a ceiling, and the edge line 423 intersects and covers the projection area 42. The corner point 44 of the area; As shown in FIG. 16, a horizontal line L1 which is tangent to the corner 44 of the region having the largest inner angle is defined in the edge line 423, and extends perpendicularly to the edge line 423 from the point P0 of the horizontal line L1. Line L2, and the intersection of the horizontal line L1 and the vertical line L2, respectively, is defined by the distance from the edge line 423 to form three reference points P1, P2, P3, and a reference rectangle is determined as the reference points P1, P2 on the horizontal line L1. The distance between the horizontal line L1 and the vertical line L2, and the distance between the reference points P3 on the vertical line L2 is high; the reference rectangle is defined to extend the intersection point, and is proportionally enlarged to any of the reference rectangles When the vertex intersects the edge line 423, the transition region 43 is formed; as shown in FIGS. 17 to 20, a straight line defined by the corner point 44 of the region having the largest inner angle and the corner point 44 of the region opposite thereto is defined as Adjacent to the line 46, and defining the projection area 42 by the abutment line 46 to form a dihedral area 424, and the parallelograms in the area surrounded by the area corners 44 of the area 424 are The conversion area 43 is converted in the same manner as the first embodiment, so This will not be repeated here.

續請參閱第21圖至第27圖所示,其係本發明之第三實施例,其與第一實施例之差別在於,該投影單元1投影一第一曲面校正畫面7,並由該影像擷取單元3擷取該第一曲面校正畫面7,於本實施例中,該第一曲面校正畫面7為間隔排列之縱向線71,但不以此作為限定;如第21圖及第23圖所示,該投影單元1投影一對應該於第一曲面校正畫面7成形網格之第二曲面校正畫面8,於本實施例中,該第二曲面校正畫面8為間隔排列之橫向線81,該影像擷取單元3擷取該第二曲面校正畫面8,並將該二值化圖像4細線化成一細線化圖像9,如第24圖所示,並定義於該細線化圖像9中,該第一曲面校正畫面7及第二曲面校正畫面8具有交點而形成所述之網格者,則該投影面2為曲面;次請參閱第25圖及第26圖所示,於該細線化圖像9內定義一基準線91,分別搜尋縱向線71及橫向線81之交點座標,以判定所述網格之複數座標 點92;如第27圖所示,定義該等座標點92所形成之區域為所述之投影區域42,本實施例於投影區域42內求得平行四邊形範圍為所述轉換區域43之轉換方式與第一實施例雷同,故在此不予贅述。 Continuing to refer to FIG. 21 to FIG. 27, which is a third embodiment of the present invention, which differs from the first embodiment in that the projection unit 1 projects a first curved surface correction picture 7 and is composed of the image. The first surface correction screen 7 is the longitudinal line 71 arranged in the interval, but is not limited thereto; as shown in FIG. 21 and FIG. 23 As shown in the figure, the projection unit 1 projects a pair of second curved surface correction pictures 8 which should be formed on the first curved surface correction picture 7. In the embodiment, the second curved surface correction picture 8 is a horizontal line 81 arranged at intervals. The image capturing unit 3 captures the second curved surface correction image 8 and thins the binary image 4 into a thinned image 9, as shown in FIG. 24, and is defined in the thinned image 9 The first curved surface correction screen 7 and the second curved surface corrected image 8 have intersections to form the mesh, and the projection surface 2 is a curved surface; see FIG. 25 and FIG. 26 for the second time. A reference line 91 is defined in the thinned image 9 to search for intersection coordinates of the longitudinal line 71 and the transverse line 81, respectively. To determine the grid coordinates of the complex Point 92; as shown in FIG. 27, the area formed by the coordinate points 92 is defined as the projection area 42. In this embodiment, the parallelogram range is determined in the projection area 42 as the conversion mode of the conversion area 43. It is the same as the first embodiment, so it will not be described here.

是由上述說明及設置,顯見本發明主要具有下列數項優點及功效,茲逐一詳述如下: It is obvious from the above description and setting that the present invention has the following several advantages and effects, which are detailed as follows:

1.本發明透過影像擷取單元擷取校正畫面,並判定所述之邊緣線係形成四個區域角點者,則該投影面為單一平面;定義六條所述之邊緣線,且界定所述邊緣線於極座標中形成三對夾角近似者,則該投影面為雙平面;定義於該細線化圖像中,該第一曲面校正畫面及第二曲面校正畫面具有交點而形成所述之網格者,則該投影面為曲面;本發明即藉以對應校正該投影單元投影之影像,顯見本發明能適用於各式投影面,如:牆壁轉角、天花板接縫或球形拱門,且皆不導致投影單元所投之影像扭曲變形,故本發明具廣泛之適用性。 1. The present invention captures a correction picture through an image capturing unit, and determines that the edge line system forms four corner points, the projection surface is a single plane; defining six of the edge lines, and defining the Wherein the edge line forms three pairs of angle approximations in the polar coordinates, the projection surface is a double plane; defined in the thinned image, the first curved surface correction picture and the second curved surface corrected picture have intersections to form the net In the case of the grid, the projection surface is a curved surface; the invention is used to correct the projection of the projection unit, and the invention can be applied to various projection surfaces, such as wall corners, ceiling seams or spherical arches, without causing The image projected by the projection unit is distorted, so the invention has wide applicability.

2.本發明之投影單元可為微型投影機,且可投影擴增實境之影像,而該影像擷取單元為網路攝影機,其體積皆較為微小,故可無負擔的掛設於使用者胸前,利於攜帶並能隨時投影於各式投影面,並能投影正確之影像而不扭曲失真,故本發明顯具便利性及適用性之功效,且若係投影擴增實境之影像者,將使該擴增實境影像更具真實性。 2. The projection unit of the present invention can be a pico projector, and can project an augmented reality image, and the image capturing unit is a network camera, and the volume thereof is relatively small, so that the user can be hung without burden. The chest is convenient to carry and can be projected on various projection surfaces at any time, and can project the correct image without distorting the distortion, so the invention has the convenience and applicability, and if the projection is augmented reality Will make the augmented reality image more authentic.

3.本發明透過訓練資料庫進行膚色判定之學習,且使用者僅需將手部置於該影像擷取單元前一段時間,使手部區域於該影像擷取單元畫面之面積大於一面積定值並持續一時間定值後,即可啟閉所述投影單元,而若係非膚色之物體,則無法啟閉該投影單元,防止影像擷取單元誤判而關閉該投影單元,藉以提升本發明於開關上之便利性。 3. The invention learns the skin color determination through the training database, and the user only needs to place the hand in the image capturing unit for a period of time, so that the area of the hand region on the image capturing unit screen is larger than an area. After the value is continued for a period of time, the projection unit can be opened and closed, and if the object is not a skin color, the projection unit cannot be opened and closed, and the image capturing unit is prevented from being misjudged to close the projection unit, thereby improving the present invention. The convenience of the switch.

4.本發明之影像擷取單元畫面係擷取環境光度,並於環境光度低 於該光度門檻值時自動啟動所述之投影單元進行投影,達致使用上便利性之功效者。 4. The image capturing unit of the present invention captures ambient luminosity and has low ambient luminosity When the photometric threshold is used, the projection unit is automatically activated to perform projection, so as to achieve the convenience of use.

綜上所述,本發明所揭露之技術手段確能有效解決習知等問題,並達致預期之目的與功效,且申請前未見諸於刊物、未曾公開使用且具長遠進步性,誠屬專利法所稱之發明無誤,爰依法提出申請,懇祈 鈞上惠予詳審並賜准發明專利,至感德馨。 In summary, the technical means disclosed by the present invention can effectively solve the problems of the prior knowledge, achieve the intended purpose and efficacy, and are not found in the publication before publication, have not been publicly used, and have long-term progress, The invention referred to in the Patent Law is correct, and the application is filed according to law, and the company is invited to give a detailed examination and grant a patent for invention.

惟以上所述者,僅為本發明之數種較佳實施例,當不能以此限定本發明實施之範圍,即大凡依本發明申請專利範圍及發明說明書內容所作之等效變化與修飾,皆應仍屬本發明專利涵蓋之範圍內。 The above is only the preferred embodiments of the present invention, and the scope of the present invention is not limited thereto, that is, the equivalent changes and modifications made by the scope of the invention and the contents of the invention are all It should remain within the scope of this invention.

1‧‧‧投影單元 1‧‧‧projection unit

11‧‧‧校正畫面 11‧‧‧Correction screen

2‧‧‧投影面 2‧‧‧Projection surface

3‧‧‧影像擷取單元 3‧‧‧Image capture unit

6‧‧‧反射單元 6‧‧‧Reflective unit

Claims (9)

一種曲面之投影校正控制方法,其步驟包含:(a)一投影單元於一投影面投影一第一曲面校正畫面,並由該影像擷取單元擷取該第一曲面校正畫面;(b)該投影單元投影一對應該於第一曲面校正畫面成形網格之第二曲面校正畫面,該影像擷取單元擷取該第二曲面校正畫面,並定義該第一曲面校正畫面及第二曲面校正畫面之灰階影像值域,予以二值化成一二值化圖像;(c)將該二值化圖像細線化成一細線化圖像,並定義於該細線化圖像中,該第一曲面校正畫面及第二曲面校正畫面具有交點而形成所述之網格者,則該投影面為曲面;並將該二值化圖像劃分為背景區域及投影區域;(d)定義所述投影區域內之平行四邊形範圍為轉換區域,並由該轉換區域界定校正參數以對應校正該投影單元投影之影像;(e)該影像擷取單元擷取一手部影像,以對應形成一手部區域;以及(f)於該手部區域面積大於一面積定值並持續一時間定值後,控制啟閉所述之投影單元。 A projection correction control method for a curved surface, the method comprising: (a) a projection unit projecting a first curved surface correction image on a projection surface, and capturing, by the image capturing unit, the first curved surface correction image; (b) the The projection unit projects a pair of second surface correction pictures that should be formed on the first surface correction picture forming grid, the image capturing unit captures the second surface correction picture, and defines the first surface correction picture and the second surface correction picture The grayscale image range is binarized into a binarized image; (c) the binarized image is thinned into a thinned image and defined in the thinned image, the first curved surface The correction picture and the second curved surface correction picture have intersection points to form the mesh, and the projection surface is a curved surface; and the binarized image is divided into a background area and a projection area; (d) defining the projection area The parallelogram in the range is a conversion area, and the correction parameter is defined by the conversion area to correspondingly correct the image projected by the projection unit; (e) the image capturing unit captures a hand image to form a hand area; After and (f) area is greater than a given value to the area of the hand and a duration time setting, the control of the opening and closing of the projection unit. 如申請專利範圍第1項所述之曲面之投影校正控制方法,其步驟更進一步包含:(g)於該細線化圖像內定義一基準線,以判定所述網格之複數座標點;以及,(h)定義該等座標點所形成之區域為所述之投影區域。 The method for controlling a projection correction of a curved surface according to claim 1, wherein the step further comprises: (g) defining a reference line in the thinned image to determine a plurality of coordinate points of the grid; (h) defining the area formed by the coordinate points as the projected area. 如申請專利範圍第1項所述之曲面之投影校正控制方法,其步驟更進一步包含:(i)將該手部影像二值化為手部二值化圖像,並透過使用者自定義劃分為膚色區域及非膚色區域;(j)建立一訓練資料庫,其儲存並依所述膚色區域定義每一顏色之機率值,以及界定一膚色門檻值;(k)判定機率值大於該膚色門檻值之顏色為膚色值,並依所述膚色值形成一手部區域。 The projection correction control method for a curved surface according to claim 1, wherein the step further comprises: (i) binarizing the hand image into a hand binarized image, and dividing the user by a user. a skin color region and a non-skin color region; (j) establishing a training database that stores and defines a probability value for each color according to the skin color region, and defines a skin color threshold; (k) determining that the probability value is greater than the skin color threshold The color of the value is the skin color value, and a hand region is formed according to the skin color value. 如申請專利範圍第1項所述之曲面之投影校正控制方法,其步驟更進一步包含:(l)該影像擷取單元擷取環境光度;以及,(m)定義一光度門檻值,並於環境光度小於該光度門檻值時啟動所述之投影單元。 The projection correction control method for a curved surface according to claim 1, wherein the method further comprises: (1) the image capturing unit extracts ambient luminosity; and (m) defines a luminosity threshold value and is in an environment The projection unit is activated when the luminosity is less than the photometric threshold. 一種擴增實境應用系統,其包含:一投影單元,其對應投影一第一曲面校正畫面及一對應該於第一曲面校正畫面成形網格之第二曲面校正畫面於一投影面;一影像擷取單元,其對應擷取該投影面呈現之該第一曲面校正畫面及該第二曲面校正畫面,並擷取一手部影像;以及,一處理單元,其耦接於該投影單元及該影像擷取單元,該處理單元係辨識該校正畫面所成像之投影面,並分析該第一曲面校正畫面及第二曲面校正畫面之灰階影像值域,予以二值化成一二值化圖像,並將該二值化圖像細線化成一細線化圖像,並定義於該細線化圖像中,該第一曲面校正畫面及 第二曲面校正畫面具有交點而形成所述之網格者,則該投影面為曲面,並定義所述網格所形成之區域為投影區域,再於該投影區域內搜尋平行四邊形範圍者為轉換區域,透過該轉換區域校正該投影單元對應投影於該投影面之影像;該處理單元係將該手部影像對應辨識形成為一手部區域,且該處理單元設有一面積定值及一時間定值,並於該手部區域之面積大於一定值且持續至該時間定值時,操控啟閉該投影單元。 An augmented reality application system, comprising: a projection unit corresponding to projecting a first curved surface correction picture and a pair of second curved surface correction pictures that should be formed on the first curved surface correction picture on a projection surface; an image a capture unit that captures the first curved surface corrected image and the second curved surface corrected image and captures a hand image; and a processing unit coupled to the projection unit and the image a capture unit that recognizes a projection surface imaged by the correction image, and analyzes a grayscale image value field of the first curved surface correction image and the second curved surface correction image, and binarizes the image into a binary image. And thinning the binarized image into a thinned image, and defining the thinned image, the first curved surface corrected image and If the second curved surface correction image has an intersection to form the mesh, the projection surface is a curved surface, and the area formed by the mesh is defined as a projection area, and the parallelogram range is searched for in the projection area. And correcting, by the conversion area, the image projected by the projection unit on the projection surface; the processing unit is configured to identify the hand image as a hand area, and the processing unit is provided with an area setting value and a time setting value. And when the area of the hand area is greater than a certain value and continues to the time value, the projection unit is controlled to be opened and closed. 如申請專利範圍第5項所述之擴增實境應用系統,更進一步包含一反射單元,其對應設於該投影單元,藉以調整該投影單元投影之角度。 The augmented reality application system of claim 5, further comprising a reflection unit corresponding to the projection unit, thereby adjusting an angle of projection of the projection unit. 如申請專利範圍第5項所述之擴增實境應用系統,其中,該投影單元係投影擴增實境之影像。 The augmented reality application system of claim 5, wherein the projection unit projects an image of the augmented reality. 如申請專利範圍第5項所述之擴增實境應用系統,其中,該處理單元係依膚色值辨識為該手部區域。 The augmented reality application system of claim 5, wherein the processing unit is identified as the hand region according to a skin color value. 如申請專利範圍第5項所述之擴增實境應用系統,其中,該影像擷取單元更進一步擷取環境光度,該處理單元設有一光度門檻值,並於環境光度小於該光度門檻值時啟動所述之投影單元。 The augmented reality application system of claim 5, wherein the image capturing unit further extracts ambient luminosity, the processing unit is provided with a photometric threshold value, and when the ambient luminosity is less than the photometric threshold value, The projection unit is activated.
TW104144630A 2012-06-27 2012-06-27 Curved surface projection correction control method and its augmented reality application system TWI616100B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW104144630A TWI616100B (en) 2012-06-27 2012-06-27 Curved surface projection correction control method and its augmented reality application system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW104144630A TWI616100B (en) 2012-06-27 2012-06-27 Curved surface projection correction control method and its augmented reality application system

Publications (2)

Publication Number Publication Date
TW201615007A TW201615007A (en) 2016-04-16
TWI616100B true TWI616100B (en) 2018-02-21

Family

ID=56361326

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104144630A TWI616100B (en) 2012-06-27 2012-06-27 Curved surface projection correction control method and its augmented reality application system

Country Status (1)

Country Link
TW (1) TWI616100B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11323675B2 (en) 2020-05-29 2022-05-03 Coretronic Corporation Method for generating mask, and projection apparatus for performing the same
US11792335B2 (en) 2021-03-17 2023-10-17 Coretronic Corporation Projection system and image projection method

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108320311B (en) * 2018-01-19 2020-10-09 杭州映墨科技有限公司 AR sand table calibration model calculation method capable of automatically correcting deviation
TWI804829B (en) * 2021-03-24 2023-06-11 明基電通股份有限公司 Image adjusting method, image adjusting system and projector image adjusting system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Hanhoon Park等,Simultaneous Geometric and Radiometric Adaptation to Dynamic Surfaces With a Mobile Projector-Camera System,IEEE Transactions on Circuits and Systems for Video Technology,Year 2008,Volume 18, Issue 1,Pages 110 - 115 *
Hanhoon Park等,Simultaneous Geometric and Radiometric Adaptation to Dynamic Surfaces With a Mobile Projector-Camera System,IEEE Transactions on Circuits and Systems for Video Technology,Year 2008,Volume 18, Issue 1,Pages 110 - 115。

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11323675B2 (en) 2020-05-29 2022-05-03 Coretronic Corporation Method for generating mask, and projection apparatus for performing the same
US11792335B2 (en) 2021-03-17 2023-10-17 Coretronic Corporation Projection system and image projection method

Also Published As

Publication number Publication date
TW201615007A (en) 2016-04-16

Similar Documents

Publication Publication Date Title
US10684467B2 (en) Image processing for head mounted display devices
CN107993216B (en) Image fusion method and equipment, storage medium and terminal thereof
US20150244976A1 (en) Telepresence experience
WO2015163030A1 (en) Information processing device, information processing method and program
TWI616100B (en) Curved surface projection correction control method and its augmented reality application system
US10296080B2 (en) Systems and methods to simulate user presence in a real-world three-dimensional space
EP2755164A2 (en) Display apparatus and control method for adjusting the eyes of a photographed user
CN111527468A (en) Air-to-air interaction method, device and equipment
CN108428375A (en) A kind of teaching auxiliary and equipment based on augmented reality
TWI538516B (en) Projection correction method and its application system
US20160275338A1 (en) Image processing apparatus, image processing method, and computer-readable storing medium
CN113538696A (en) Special effect generation method and device, storage medium and electronic equipment
US10134164B2 (en) Information processing apparatus, information processing system, information processing method, and program
TWI808321B (en) Object transparency changing method for image display and document camera
US9536133B2 (en) Display apparatus and control method for adjusting the eyes of a photographed user
CN113596323A (en) Intelligent group photo method, device, mobile terminal and computer program product
US20140098138A1 (en) Method and system for augmented reality based smart classroom environment
WO2023226693A1 (en) Display module and display method thereof, display apparatus, and virtual display device
JP6680294B2 (en) Information processing apparatus, information processing method, program, and image display system
JP2006318015A (en) Image processing device, image processing method, image display system, and program
CN107102726A (en) A kind of preschool education system based on AR
WO2022022260A1 (en) Image style transfer method and apparatus therefor
CN115049803A (en) Augmented reality picture display method and device, computer equipment and storage medium
KR20090090980A (en) Pointing apparatus using image
KR101488647B1 (en) Virtual illumination of operating method and apparatus for mobile terminal

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees