TWI538516B - Projection correction method and its application system - Google Patents

Description

Projection correction method and its augmented reality application system

The present invention provides a projection correction method and an augmented reality application system thereof, and more particularly to an image that can correct a projection according to a projection surface of various shapes.

According to the technology of manipulating and interacting with objects or information in the digital world, there have been many achievements in the field of virtual reality (VR), in which the presentation of information is mainly through head-mounted displays. To meet the immediate needs of observers, but the real need for computer technology applications is not the digital world simulated by computers, or the objects or environments in the virtual world. The core need is how to provide digital information in the real world. Let people still feel that they are in the real world, not to adapt to the virtual world, which makes Augmented Reality (AR) come into being.

Although most of the technologies in the virtual reality field can be directly applied to augmented reality applications, how to correctly combine the real world and the digital world is the most important technical difference, such as: The posture of the virtual object is determined by the observer's posture; the corresponding digital information is projected on the real world object, etc., all of which involve the above technical topics. The source of human information is mainly through visual, auditory, olfactory, taste and touch. The body sensory receptor receives, wherein the vision encompasses 70% of the total amount of body sensory receptors, so Obtaining information through images is the most important and convenient way for human beings. Moreover, because human beings are most sensitive to the requirements of visual quality, an ideal expanding application system requires high-quality display capabilities to conquer users. Visual satisfaction.

In virtual reality applications, head-mounted displays (helmet-type or glasses-type) are used to obtain information, making information display simpler without technical thresholds, but it also allows for virtual reality applications. It is isolated from the real world and limits its relevance to daily life. Therefore, the main uses are mainly simulation training. However, technology will ultimately come from life and human needs. It is necessary to apply virtual reality technology to daily life, which will obviously make information The display becomes the threshold of technology. Because it needs to meet the needs of people's activities, it is impossible to limit people to the traditional computer screens, and to display information in the environment. Therefore, it is necessary to research and develop a kind of display that allows users to display directly in the living environment. The required information needs have become the primary problem to be solved in the development of augmented reality application platforms.

Augmented Reality uses the technology to calculate the position and angle of camera images in the field, and through the technology of image presentation, it has a wide range of applications, and can be applied to satellite, mobile devices, surgical medical, industrial and entertainment technologies, but it is used. Augmented reality platform, presented on your own portable screen (such as: smart phone, tablet, or computer screen), or projected to the desired location using the projector.

However, the portable screen does not produce enough augmented reality coverage, so Difficult to combine with the actual image; using the projector projector, thanks to the miniaturization technology, the development of a micro projector, making it light and easy to carry, can meet the display range of personal use, but still need to reflect the image through the projection surface, Therefore, it has the problem of geometric distortion of the projection surface, and the projection range can be photographed by using high-order photographic equipment, and the projection range can be any irregular wall surface, corner, double curtain, brick wall, etc., and the projection range is taken by using high-order photographic equipment. Correction is made for each pixel change. Although it can theoretically correct any projection surface, it requires a high-order photographic equipment to complete the calibration, which requires a lot of cost, and can only produce a conventional projector. The uniform size or the standard rectangular display range will result in the loss of realism and reduced applicability of the augmented reality information.

In view of this, our inventors are concentrating on further research on projection correction methods and augmented reality application systems, and proceeding with research and development and improvement, with a better design to solve the above problems, and after continuous trial and modification There is a present invention.

The reason is that the purpose of the present invention is to solve the problem that the portable portable screen cannot generate sufficient abundance of reality, so it is difficult to combine with the actual image; if the projector is projected through the projector, the geometric distortion of the projection surface often needs to be utilized. High-end photographic equipment shoots a range of projections, which requires a large amount of cost, and can only produce a uniform size or a standard rectangular display range like a conventional projector, which will result in the loss of realism and reduce the applicability of the augmented reality information.

In order to achieve the above object, the inventors provide a projection correction method, the steps comprising: (a) a projection unit projecting a correction picture on a projection surface; (b) an image capture unit capturing the correction picture, And defining a grayscale image value field of the correction picture, binarizing into a binarized image; (c) dividing the binarized image into a background area and a projection area; and, (d) defining the projection The range of parallelograms within the region is the transition region, and the correction region is defined by the transition region to correspond to the image that corrects the projection of the projection unit.

According to the projection correction method described above, the method further comprises: (e) detecting an edge of the projection area and defining an edge line forming the edge; and (f) defining an area formed by the intersection of the edge lines The corner point is determined, and the area surrounded by the corner point of the area is determined as a coordinate equation of the projection area.

According to the projection correction method described above, wherein the step (e) defines that the edge line system forms four corner points, the projection surface is a single plane.

According to the projection correction method described above, wherein the step (e) defines six of the edge lines, and the edge line is defined to form three pairs of angle approximations in the polar coordinates, the projection surface is a double plane.

According to the projection correction method described above, the step (e) defines six corner points of the region defined by the edge lines intersecting and covering the outer contour of the projection area.

According to the projection correction method described above, the steps further include, (g) The edge line defines a horizontal line tangential to the corner point of the region having the largest inner angle, and extends from a point in the horizontal line to a vertical line intersecting the edge line, and is intersected by the intersection of the horizontal line and the vertical line, respectively The distance between the lines is defined to form three reference points, and the reference rectangle is determined by using the reference point of the two points on the horizontal line as the base length, and the intersection of the horizontal line and the vertical line, and the distance between the reference points on the vertical line is high; The reference rectangle extends the intersection and is scaled up to the transition region when any vertex of the reference rectangle intersects the edge line.

According to the projection correction method described above, wherein the step (f) defines a line formed by a corner point of the region having the largest inner angle and a corner point of the opposite region as an adjacent line, and defines the projection by the adjacent line The area is divided into two-faceted domains, and the parallelograms in the area surrounded by the corner points of the area are the transition areas.

According to the projection correction method described above, the step (e) defines a complex line of the edge by a Hough transform definition, and filters the lines to define an edge line of the projection area.

According to the projection correction method described above, the method further comprises: (h) the projection unit projecting a first curved surface correction picture, and the first surface correction picture is captured by the image capturing unit; and, (i) The projection unit projects a pair of second curved surface correction images that should be formed on the first curved surface correction screen, and the image capturing unit captures the second curved surface corrected image, and thins the binary image into one The thinned image is defined in the thinned image, and the first curved surface corrected image and the second curved surface corrected image have intersections to form the mesh, and the projected surface is a curved surface.

According to the projection correction method described above, the step further comprises: (j) defining a reference line in the thinned image to determine a plurality of coordinate points of the grid; and (k) defining the coordinates The area formed by the dots is the projected area.

The present invention provides a projection control method including the projection correction method as described above.

According to the projection control method described above, the method further comprises: (1) the image capturing unit captures a hand image; (m) binarizing the hand image into a hand binarized image, and By user-defined division into skin color area and non-skin color area; (n) establishing a training database, which stores and defines the probability value of each color according to the skin color area, and defines a skin color threshold; (o) determining The color of the probability value is greater than the skin color threshold value, and the skin color value is formed according to the skin color value; and (p) after the area of the hand region is greater than a certain area value and continues to be fixed for a time, the control is opened and closed. The projection unit.

According to the projection control method described above, the method further comprises: (q) the image capturing unit extracts ambient luminosity; and, (r) defines a photometric threshold value, and starts when the ambient luminosity is less than the photometric threshold value; The projection unit.

The present invention provides an augmented reality application system, comprising: a projection unit corresponding to projecting a corrected image on a projection surface; an image capture unit corresponding to capturing an image presented by the projection surface; and, a processing The unit is coupled to the projection unit and the image capturing unit, and the processing unit identifies the projection surface imaged by the correction image, and analyzes the grayscale image value range of the correction image to be binarized into a binarization Image, dividing the binarized image into a background area and a projection area, and searching for a parallelogram range in the projection area as a conversion area, and correcting an image of the projection unit corresponding to the projection surface through the conversion area By.

According to the augmented reality application system described above, a reflection unit is further included, which is correspondingly disposed on the projection unit, thereby adjusting the angle of projection of the projection unit.

According to the augmented reality application system described above, the projection unit is a projection image of the augmented reality.

According to the augmented reality application system described above, the projection surface is a plane, a double plane or a curved surface.

According to the augmented reality application system described above, the image capturing unit further extracts a hand image, the processing unit is identified as a hand region according to a skin color value, and the processing unit is provided with an area setting value and a The time is set, and when the area of the hand area is greater than a certain value and continues to the time value, the projection unit is turned on and off.

According to the augmented reality application system described above, wherein the image capturing unit further extracts ambient luminosity, the processing unit is provided with a luminosity threshold value, and the projection is started when the ambient luminosity is less than the luminosity threshold value. unit.

With the above arrangement, the present invention can display digital information in the real world, make the information acquisition method closer to life, and solve the problem of using the augmented reality to project the projection information into the real world, which is costly and unfavorable for carrying and The invention is designed to allow the user to hang on the chest without burden, and the reflective unit can be manually operated to adjust the height of the projection unit and adjust the projection height or the projection surface of various shapes. The invention is characterized in that the image is distorted and deformed. Therefore, the present invention projects the correction image through the projection unit, and the image capturing unit captures the projection surface of the correction image on various shapes, such as a single plane, a double plane, and a curved surface, and corrects the projection unit. The projected image shows that the present invention allows the user to search for the projection surface anytime and anywhere, such as: wall corners, ceiling seams, ball arches, etc., or projection deformation due to different depths of the plane, such as: curtains, walls, The column and the like can all overcome the problem and project the correct image; furthermore, the invention considers the convenience of use. The area of the hand area can be defined by the skin color detection, and the projection unit can be opened and closed when the area is set and time constant, and the projection can be automatically turned on by the image capturing unit. The unit avoids power consumption and at the same time improves the convenience and wide applicability of the present invention.

The invention will be described in detail below with reference to the drawings.

Please refer to the first embodiment to the first embodiment, which is a first embodiment of the present invention. The present invention is an augmented reality application system, comprising: a projection unit 1 corresponding to a projection correction screen 11 a projection surface 2, the projection unit 1 is a projection image of the augmented reality, and the projection surface 2 is a single plane, a double plane or a curved surface; an image capturing unit 3 corresponding to the image captured by the projection surface 2 a processing unit is coupled to the projection unit 1 and the image capturing unit 3, the processing unit identifies the projection surface 2 imaged by the correction screen 11, and analyzes the grayscale image range of the correction screen 11 Binarized into a binarized image 4, the binarized image 4 is divided into a background region 41 and a projection region 42, and the region of the parallelogram is searched for the transition region 43 in the projection region 42. The conversion area 43 corrects the image of the projection unit 1 corresponding to the projection surface 2, and the image capturing unit 3 captures the hand image 5, the processing unit is identified as the hand area according to the skin color value, and the processing unit is provided with a Area setting and time setting, and When the area of the hand area is greater than a certain value and continues to a fixed value of the time, the projection unit 1 is controlled to be opened and closed; the image capturing unit 3 further captures ambient luminosity, and the processing unit is provided with a luminosity threshold value, and The projection unit 1 is activated when the ambient luminosity is less than the luminosity threshold; and, A reflection unit 6 is disposed corresponding to the projection unit 1 to adjust the angle of projection of the projection unit 1.

Continuing to refer to the first to tenth drawings, the present invention provides a projection correction method, the method comprising: a projection unit 1 projecting a correction picture 11 on a projection surface 2; an image capture unit 3 captures the Correcting the screen 11, assuming that the color space of the image capturing unit 3 is three primary colors (RGB), the corrected image 11 captured by the image capturing unit 3 is defined as IC(x _c , y _c ) {R, G, B}, and define the grayscale image range of the correction screen 11 as [0, 255], and set the grayscale correction screen 11 to ICg (x _cg , y _cg ) to obtain ICg (x _cg , y _cg ) [0, 255], as shown in the third and fourth figures, and then binarized into a binarized image 4, thereby dividing the binarized image 4 into a background region 41 and a projection region 42, and defining the Binarized image 4 is ICb (x _cb , y _cb ) {0,1}; detecting the edge 421 of the projection area 42 in the binarized image 4, and obtaining an edge image of the binarized image 4 as ICe(x _ce , y _ce ) {0, 1}, and as shown in the fifth and sixth figures, the complex line 422 of the edge 421 is formed by the Hough transform definition, which will cause the misjudgment of the edge 421 detection, so the line 422 is Redundant linear filtering, defining an edge line 423 forming the edge 421 of the projection area 42, and defining the edge line 423 to form four regional corner points 44, the projection surface 2 is a single plane; defined by the edge The line corners 44 intersect at the intersection of the line 423. As shown in the fourth figure, the coordinates of the corner point 44 of the area can be obtained, and the area surrounded by the corner point 44 of the area is determined, which is the coordinate equation of the area of the projection area 42. The range of the parallelogram defining the coordinate equation of the projection area is the conversion area 43. For example, as shown in the seventh figure, the projection area 42 is a quadrilateral, and the corner point 44 of the area is the apex of the quadrilateral. The edge line 423 is a quadrilateral edge, and a corner point 44a of the upper end is projected toward the y-axis direction to the opposite side of the edge line 423a to form a transition point 45a, and the corner point 44b of the other upper end is formed. Corresponding to the slope of the edge line 423a, corresponding to the transition point 45a A conversion point 45b is formed, thereby defining a parallelogram formed by the area corner points 44a, 44b and the conversion points 45a, 45b as the conversion area 43; see the upper left diagram of the eighth figure, which is before the correction in the projection unit 1. Preview the projected image, assuming that its coordinate points are I ₀ (0,0), I ₁ (iX-1,0), I ₂ (iX-1,iY-1), and I ₃ (0,iY-1) The result of the projection on the projection surface 2 is as shown in the upper right diagram of the eighth figure, which is the image captured by the image capturing unit 3, so that the coordinate points of the correction screen 11 are respectively P ₀ (x ₀ , y ₀ ), P ₁ (x ₁ , y ₁ ), P ₂ (x ₂ , y ₂ ), and P ₃ (x ₃ , y ₃ ), defining points I ₀ , I ₁ , I ₂ , I _{3 ,} and points _{P 0, P 1, P 2} , P converter ₃ the relationship _{{P 0, P 1, P} 2, P 3} = T 1 {I 0, I 1, I 2, I 3}, so as to search for the projection unit 1 for the projection surface 2 to project the correction picture 11 as a function of distortion, and as shown in the lower right diagram of the eighth figure, the coordinate points of the conversion area 43 are PI ₀ (xpi ₀ , ypi ₀ ), P _{1 respectively.} (xpi ₁ , ypi ₁ ), P ₂ (xpi ₂ , ypi ₂ ), and P ₃ (xpi ₃ , ypi ₃ ), and the conversion relationship between the correction picture 11 and the conversion area 43 is {PI ₀ , PI ₁ , PI ₂ , PI ₃ }=T ₂ {P ₀ , P ₁ , P ₂ , P ₃ }, and the projections of the projected projection unit 1 are back-converted by T ₁ and T ₂ , Therefore, a calibration parameter T ₃ = T ₂ T ₁ {P ₀ , P ₁ , P ₂ , P ₃ }, the coordinate points of the preview projection screen of the projection unit 1 are PT ₀ (PTx ₀ , PTy ₀ ), P ₁ (PTx ₁ , respectively). PTy ₁ ), P ₂ (PTx ₂ , PTy ₂ ), and P ₃ (PTx ₃ , PTy ₃ ), as shown in the lower left diagram of the eighth figure, correspond to the image of the projection of the projection unit 1 .

Continuing to refer to the ninth and tenth embodiments, the present embodiment provides a projection control method, the method comprising: the image capturing unit 3 captures a hand image 5; the invention utilizes the YCbCr color space as a color The representation is used to match the changes of the application scene and the ambient lighting, and the RGB color space has no separation of color and brightness. Therefore, the hand image captured by the image capturing unit 3 needs to first convert the RGB color space. For the YCbCr color space, the conversion is as follows:

In order to determine the correct skin color, it is necessary to establish a training database in the processing unit for learning the skin color determination. Therefore, the hand image 5 is first binarized into the hand binarized image 51, and is used. Customized to be divided into skin color areas 52 And a non-skinning area 53; storing in the training database and defining a probability value of each color according to the skin color area 52, and defining a skin color threshold value, determining that the probability value is greater than the skin color threshold value as the skin color value, and The skin color value forms a hand region; after the area of the image of the image capturing unit 3 is greater than an area constant value and continues to be fixed for a time, for example, the user places the hand in the image capturing unit 3 In the first two seconds, the processing unit controls the opening and closing of the projection unit 1; the image capturing unit 3 further extracts ambient luminosity; and the processing unit defines a luminosity threshold value, and the ambient luminosity is less than the luminosity The projection unit 1 is activated when the threshold is reached.

Referring again to FIGS. 11 to 20, which is a second embodiment of the present invention, which differs from the first embodiment in that six of said edge lines 423 are defined and the edges are defined The line 423 forms three pairs of angle approximations in the polar coordinates, and the projection surface is a double plane, such as a corner of a wall or a seam of a ceiling, and the edge line 423 intersects and covers the contour of the projection area 42. region of the six corners 44 defined; as shown in FIG sixteenth, defines the edge line 423 in a horizontal line tangent to the internal angle of the corner points of maximum area of 44 L _1, and the horizontal line L ₁ in the The midpoint P ₀ extends to the vertical line L _{2 of} the edge line 423, and the intersection of the horizontal line L ₁ and the vertical line L ₂ is respectively defined by the distance from the edge line 423 to form three reference points P ₁ , P ₂ , P _3, is determined as a reference rectangle to the horizontal line L ₁ on the two reference points P _1, P ₂ is the length of the base, and a horizontal line on the vertical line L ₁ and L ₂ of the intersection point, and the vertical line L ₂ reference point P ₃ of a high pitch; rectangle defining the reference point of intersection of the extension, and the like according to any scaling of the reference rectangle When the vertex intersects the edge line 423, the transition region 43 is formed; as shown in FIGS. 17 to 20, the corner point 44 of the region having the largest inner angle is defined and the corner point 44 of the region opposite thereto is formed. The straight line is the adjoining line 46, and the projection area 42 is divided by the abutment line 46 into two distinct regions 424, and the parallelograms in the region surrounded by the corners 44 of the region 424 are respectively The conversion area 43 is converted in the same manner as the first embodiment, and therefore will not be described herein.

Continuing to refer to the twenty-first to twenty-seventh drawings, which is a third embodiment of the present invention, which differs from the first embodiment in that the projection unit 1 projects a first curved surface correction picture 7, The first curved surface correction screen 7 is captured by the image capturing unit 3 in the embodiment. In the embodiment, the first curved surface corrected image 7 is a longitudinal line 71 arranged at intervals, but is not limited thereto; As shown in FIG. 21 and FIG. 23, the projection unit 1 projects a pair of second curved surface correction pictures 8 which should be formed on the first curved surface correction picture 7. In the present embodiment, the second curved surface correction picture 8 Horizontal line 81. The image capturing unit 3 captures the second curved surface correction image 8 and thins the binary image 4 into a thinned image 9, as shown in FIG. 24, and is defined in the thinning In the image 9, the first curved surface correction picture 7 and the second curved surface correction picture 8 have intersection points to form the mesh, and the projection surface 2 is a curved surface; please refer to the twenty-fifth figure and the twentieth As shown in FIG. 6 , a reference line 91 is defined in the thinned image 9 , and the intersection coordinates of the longitudinal line 71 and the transverse line 81 are respectively searched to determine the plurality of coordinate points 92 of the grid; The area defined by the coordinate points 92 is defined as the projection area 42. The conversion manner of the parallelogram range in the projection area 42 to the conversion area 43 is the same as that of the first embodiment. Therefore, I will not repeat them here.

It is obvious from the above description and setting that the present invention has the following several advantages and effects, which are detailed as follows:

1. The present invention captures a correction picture through an image capturing unit, and determines that the edge line system forms four corner points, the projection surface is a single plane; defining six of the edge lines, and defining the Wherein the edge line forms three pairs of angle approximations in the polar coordinates, the projection surface is a double plane; defined in the thinned image, the first curved surface correction picture and the second curved surface corrected picture have intersections to form the net In the case of the grid, the projection surface is a curved surface; the invention is used to correct the projection of the projection unit, and the invention can be applied to various projection surfaces, such as walls. The invention has wide applicability because of corners, ceiling seams or spherical arches, and does not cause distortion of the image projected by the projection unit.

2. The projection unit of the present invention can be a pico projector, and can project an augmented reality image, and the image capturing unit is a network camera, and the volume thereof is relatively small, so that the user can be hung without burden. The chest is convenient to carry and can be projected on various projection surfaces at any time, and can project the correct image without distorting the distortion, so the invention has the convenience and applicability, and if the projection is augmented reality Will make the augmented reality image more authentic.

3. The invention learns the skin color determination through the training database, and the user only needs to place the hand in the image capturing unit for a period of time, so that the area of the hand region on the image capturing unit screen is larger than an area. After the value is continued for a period of time, the projection unit can be opened and closed, and if the object is not a skin color, the projection unit cannot be opened and closed, and the image capturing unit is prevented from being misjudged to close the projection unit, thereby improving the present invention. The convenience of the switch.

4. The image capturing unit screen of the present invention captures the ambient luminosity and automatically activates the projection unit to project when the ambient luminosity is lower than the illuminance threshold, thereby achieving the convenience of use.

In summary, the technical means disclosed by the present invention can effectively solve the problems of the prior knowledge, achieve the intended purpose and efficacy, and are not found in the publication before publication, have not been publicly used, and have long-term progress, The invention claimed in the Patent Law is correct, Applying according to law, praying for a detailed review and granting a patent for invention, to Sendexin.

The above is only the preferred embodiments of the present invention, and the scope of the present invention is not limited thereto, that is, the equivalent changes and modifications made by the scope of the invention and the contents of the invention are all It should remain within the scope of this invention.

1‧‧‧projection unit

11‧‧‧Correction screen

2‧‧‧Projection surface

3‧‧‧Image capture unit

4‧‧‧ binarized image

41‧‧‧Background area

42‧‧‧Projection area

Edge of 421‧‧

422‧‧‧ Straight line

423‧‧‧ edge line

424‧‧‧ Faces

43‧‧‧Conversion area

44, 44a, 44b‧‧‧ regional corner points

45a, 45b‧‧‧ conversion point

46‧‧‧ Adjacent lines

5‧‧‧Hand image

51‧‧‧Hand binarized image

52‧‧‧ skin color area

53‧‧‧Non-skin area

6‧‧‧Reflective unit

7‧‧‧First surface correction screen

71‧‧‧Longitudinal line

8‧‧‧Second surface correction screen

81‧‧‧ horizontal line

9‧‧‧ Thin line image

91‧‧‧ baseline

92‧‧‧Punctuation

The first figure is a schematic view of the structure of the present invention.

The second figure is a schematic flow chart of the first embodiment of the present invention.

The third figure is a schematic diagram of the binarized image of the first embodiment of the present invention.

The fourth figure is a schematic diagram of edge detection according to the first embodiment of the present invention.

Fig. 5 is a schematic diagram showing the Hough conversion of the first embodiment of the present invention.

Fig. 6 is a schematic view showing the linear filtration of the first embodiment of the present invention.

Figure 7 is a schematic diagram showing the definition conversion area of the first embodiment of the present invention.

Figure 8 is a schematic view showing a projection image of a conversion correcting projection unit of the first embodiment of the present invention.

The ninth embodiment of the present invention is an image capturing unit that captures a hand image schematic diagram.

Tenth is a schematic view of a hand binarized image of the first embodiment of the present invention.

Figure 11 is a flow chart showing the second embodiment of the present invention.

Figure 12 is a schematic diagram of a binarized image of a second embodiment of the present invention.

Figure 13 is a schematic diagram of edge detection in accordance with a second embodiment of the present invention.

Fig. 14 is a schematic diagram showing the Hough conversion of the second embodiment of the present invention.

Fig. 15 is a schematic view showing the linear filtration of the second embodiment of the present invention.

Fig. 16 is a schematic view showing a definition conversion area of the second embodiment of the present invention.

Figure 17 is a schematic view showing the adjacent line of the second embodiment of the present invention.

Figure 18 is a schematic view showing a second embodiment of the present invention adjacent to a line drawing sub-area.

Fig. 19 is a schematic view showing a projection image of a projection conversion unit of the left side of the second embodiment of the present invention.

Fig. 20 is a schematic view showing the projection image of the projection conversion unit of the right side of the second embodiment of the present invention.

A twenty-first embodiment is a schematic flow chart of a third embodiment of the present invention.

Twenty-second drawing is a schematic diagram of the first curved surface correction screen of the third embodiment of the present invention Figure.

Twenty-third is a schematic diagram of a second curved surface correction screen of the third embodiment of the present invention.

Twenty-fourth Embodiment A schematic diagram of thinning a binarized image of the third embodiment of the present invention into a thinned image.

Twenty-fifthth Figure is a schematic diagram showing the definition of coordinate points of the reference line of the third embodiment of the present invention.

Figure 26 is a schematic view showing the formation of a projection area by the coordinate points of the third embodiment of the present invention.

Figure 27 is a schematic view showing a conversion area of a third embodiment of the present invention.

1‧‧‧projection unit

11‧‧‧Correction screen

2‧‧‧Projection surface

3‧‧‧Image capture unit

6‧‧‧Reflective unit

Claims (12)

A projection correction method, the method comprising: (a) a projection unit projecting a correction picture on a projection surface; (b) an image capture unit capturing the correction picture and defining a grayscale image range of the correction picture Dividing into a binarized image; (c) dividing the binarized image into a background region and a projection region; (d) defining a parallelogram range in the projection region as a conversion region, and Converting a region defining a correction parameter to correspondingly correct an image projected by the projection unit (e) detecting an edge of the projection region and defining an edge line forming the edge; defining six of the edge lines and defining the edge line Forming three pairs of angle approximations in the polar coordinates, the projection surface is a biplane; and (f) defining a corner point formed by the intersection of the edge lines, and determining that the area surrounded by the corner points is a projection area The coordinate equation. The projection correction method according to claim 1, wherein the step (e) defines six corner points of the region by the edge lines intersecting and covering the outer contour of the projection area. The method of projecting correction according to item 2 of the patent application, the steps of which are more Further comprising: (g) defining a horizontal line in the edge line that is tangent to a corner point of the region having the largest inner angle, and extending from a point in the horizontal line to a vertical line intersecting the edge line, and being horizontal and vertical The intersection of the lines, the distance from the edge line is defined to form three reference points, and the reference rectangle is determined by using the reference point of the two points on the horizontal line as the base length, and the intersection of the horizontal line and the vertical line, and the reference line on the vertical line. The distance between the points is high; the reference rectangle is defined to extend the intersection point, and is enlarged to the transition area when any vertex of the reference rectangle intersects the edge line. The projection correction method according to claim 2, wherein the step (f) defines a line formed by a corner point of the region having the largest inner angle and a corner point of the opposite region as an adjacent line, and is defined by the line The adjacent line divides the projection area into two-sided areas, and the parallelograms in the area surrounded by the corner points of the area respectively are the conversion areas. The projection correction method of claim 1, wherein the step (e) forms a complex line of the edge by a Hough transform definition and filters the lines to define an edge line of the projection area. A projection control method, comprising the projection correction method according to any one of claims 1 to 5, the method further comprising: (1) the image capturing unit capturing a hand image; (m) binarizing the hand image into a hand binarized image and dividing it into a skin color region and a non-skin color region by user customization; (n) establishing a training database, which is stored and described The skin color region defines a probability value of each color, and defines a skin color threshold value; (o) determines that the color of the probability value is greater than the skin color threshold value, and forms a hand region according to the skin color value; and, (p) After the area of the hand area is greater than an area constant and continues to be fixed for a time, the projection unit is controlled to be opened and closed. The method of claim 2, wherein the step further comprises: (q) the image capturing unit extracts ambient luminosity; and (r) defines a luminosity threshold, and the ambient luminosity is less than the The projection unit is activated when the photometric threshold is reached. An augmented reality application system, comprising: a projection unit corresponding to projecting a correction image on a projection surface; an image capture unit corresponding to capturing an image presented by the projection surface; and a processing unit Coupled in the projection unit and the image capturing unit, The processing unit identifies the projection surface imaged by the correction picture, analyzes the grayscale image value range of the correction picture, binarizes it into a binarized image, and divides the binarized image into a background area and a projection. a region, and detecting an edge of the projection region, and defining an edge line forming the edge, defining six of the edge lines, and defining the edge line to form three pairs of angle approximations in the polar coordinates, the projection surface is The two planes are then searched for the parallelogram range in the projection area as a conversion area, and the projection area is corrected by the projection area corresponding to the image projected on the projection surface. The augmented reality application system of claim 8, further comprising a reflection unit corresponding to the projection unit, thereby adjusting an angle of projection of the projection unit. The augmented reality application system of claim 8, wherein the projection unit projects an image of the augmented reality. The augmented reality application system of claim 8, wherein the image capturing unit further captures a hand image, the processing unit is identified as a hand region according to a skin color value, and the processing unit is provided with a The area setting value and the time setting value are controlled to open and close the projection unit when the area of the hand area is greater than a certain value and continues to the time value. The augmented reality application system of claim 8, wherein the image capturing unit further extracts ambient luminosity, and the processing unit is provided a photometric threshold value and the projection unit is activated when the ambient luminosity is less than the photometric threshold.