CN107025674B - Method and system for displaying painting identification picture based on augmented reality - Google Patents
Method and system for displaying painting identification picture based on augmented reality Download PDFInfo
- Publication number
- CN107025674B CN107025674B CN201710136594.2A CN201710136594A CN107025674B CN 107025674 B CN107025674 B CN 107025674B CN 201710136594 A CN201710136594 A CN 201710136594A CN 107025674 B CN107025674 B CN 107025674B
- Authority
- CN
- China
- Prior art keywords
- painting
- augmented reality
- identification
- feature points
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/40—Filling a planar surface by adding surface attributes, e.g. colour or texture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method and a system for displaying a painting identification picture based on augmented reality, wherein the method comprises the following steps: s1, scanning the color painting identification picture to obtain a scanning picture corresponding to the color painting identification picture, wherein the color painting identification picture comprises a plurality of feature points which can be identified by the augmented reality technology; s2, extracting the characteristic points in the scanning image; s3, performing augmented reality processing on the extracted feature points to obtain matching models corresponding to the feature points; and S4, carrying out virtual reality image synthesis on the matching model and the scanogram, and sending the synthesized image to the mobile terminal for display. The invention has the beneficial effects that: the method comprises the steps of scanning a painted identification picture painted by a user to obtain a corresponding scanned picture, extracting feature points in the scanned picture, obtaining a matching model corresponding to the feature points through an augmented reality technology, and displaying the matching model through a mobile terminal to provide good visual effect experience for the user.
Description
Technical Field
The invention relates to the technical field of augmented reality, in particular to a method and a system for displaying a painting identification picture based on augmented reality.
Background
The painting is an artistic activity which is suitable for the early development of the infants and can exercise the hand-eye-brain coordination ability of the infants. The painting activities can not only fully show the knowledge of the children on the objective world around, but also reflect the life experiences of the children. Children can express the world in eyes by painting, inspire thinking and exercise the ability of thinking. The color painting can promote children to exercise hand-eye-brain coordination, develop observation capability and practice capability. This is a good early education activity for children. However, the current painting products have poor interactivity, have no other functions except painting, are single and tedious, and simultaneously cannot enable the works of the current painting products to be dynamically and stereoscopically displayed, so that better visual experience cannot be provided for users.
Disclosure of Invention
The invention provides a method and a system for displaying a painting identification picture based on augmented reality, which solve the technical problems of single function and poor visual effect in the prior art.
The technical scheme for solving the technical problems is as follows: a method for displaying a painting identification picture based on augmented reality comprises the following steps:
s1, scanning the color painting identification picture to obtain a scanning picture corresponding to the color painting identification picture, wherein the color painting identification picture comprises a plurality of feature points which can be identified by the augmented reality technology;
s2, extracting the characteristic points in the scanning image;
s3, performing augmented reality processing on the extracted feature points to obtain matching models corresponding to the feature points;
and S4, synthesizing the virtual reality image of the matching model and the scanogram, and sending the synthesized image to a mobile terminal for display.
The invention has the beneficial effects that: the method comprises the steps of scanning a painted identification picture painted by a user to obtain a corresponding scanned picture, extracting feature points in the scanned picture, obtaining a matching model corresponding to the feature points through an augmented reality technology, and displaying the matching model through a mobile terminal to provide good visual effect experience for the user.
On the basis of the technical scheme, the invention can be further improved as follows.
Preferably, before the step S1, the method further includes:
and S0, making the painting identification picture.
Preferably, the step S0 specifically includes:
s101, selecting a first number of identification graphs with the same size and different patterns;
s102, randomly selecting a second number of identification images from the identification images as background images;
s103, taking the Unity as a verification tool to build a verification project;
s104, verifying the background image through the verification engineering to obtain a verification result;
and S105, splicing the background image according to the verification result, and taking the middle margin as a painting area to obtain the painting identification image.
Preferably, the background map is provided with a plurality of feature points recognizable by augmented reality technology, and the background map is a non-monotone repeated pattern.
Preferably, the area of the painting region accounts for 30% -50% of the painting identification map.
An augmented reality-based paint identification map display system, comprising:
the scanning module is used for scanning the color painting identification picture to obtain a scanning picture corresponding to the color painting identification picture, and the color painting identification picture comprises a plurality of feature points which can be identified by an augmented reality technology;
the extraction module is used for extracting the characteristic points in the scanning image;
the processing module is used for carrying out augmented reality processing on the extracted feature points and acquiring a matching model corresponding to the feature points;
and the synthesis module is used for carrying out virtual reality image synthesis on the matching model and the scanogram and sending the synthesized image to a mobile terminal for display.
Preferably, before the scanning module, the method further comprises: and the manufacturing module is used for manufacturing the painting identification picture.
Preferably, the production module is specifically configured to:
selecting a first number of identification graphs with the same size and different patterns;
randomly selecting a second number of recognition images from the recognition images as background images;
building a verification project by taking Unity as a verification tool;
verifying the background image through the verification engineering to obtain a verification result;
and splicing the background images according to the verification result, and leaving white in the middle as a painting area to obtain the painting identification image.
Preferably, the background map is provided with a plurality of feature points recognizable by augmented reality technology, and the background map is a non-monotone repeated pattern.
Preferably, the area of the painting region accounts for 30% -50% of the painting identification map.
Drawings
Fig. 1 is a schematic flowchart of a method for displaying a color recognition map based on augmented reality according to an embodiment of the present invention;
FIG. 2 is a paint color identification chart provided in accordance with another embodiment of the present invention;
fig. 3 is a schematic structural diagram of a display system of a color recognition graph based on augmented reality according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a display system of a color recognition graph based on augmented reality according to another embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, in an embodiment, a method for displaying a color recognition map based on augmented reality is provided, including:
s1, scanning the color painting identification picture to obtain a scanning picture corresponding to the color painting identification picture, wherein the color painting identification picture comprises a plurality of feature points which can be identified by the augmented reality technology;
s2, extracting the characteristic points in the scanning image;
s3, performing augmented reality processing on the extracted feature points to obtain matching models corresponding to the feature points;
and S4, carrying out virtual reality image synthesis on the matching model and the scanogram, and sending the synthesized image to the mobile terminal for display.
Specifically, a painting identification picture painted by a user is scanned through a camera, a corresponding scanned picture is obtained, feature points in the scanned picture are extracted, a matching model corresponding to the feature points is obtained through an augmented reality technology, and the matching model is displayed through a mobile terminal, so that good visual effect experience is brought to the user.
Before step S1, the method further includes:
and S0, making a color identification picture.
Step S0 specifically includes:
s101, selecting a first number of identification graphs with the same size and different patterns;
s102, randomly selecting a second number of identification images from the identification images as background images;
s103, taking the Unity as a verification tool to build a verification project;
s104, verifying the background image through a verification project to obtain a verification result;
and S105, splicing the background images according to the verification result, and leaving white in the middle to be used as a color painting area to obtain a color painting identification image.
The background image is provided with a plurality of characteristic points which can be identified by the augmented reality technology, and the background image is a non-monotone repeated pattern.
The area of the painting area accounts for 30-50% of the proportion range of the painting identification diagram.
Specifically, the method for manufacturing the color-coated identification picture comprises the following steps: step 1, selecting 8 identification pictures with the same size and different patterns; step 2, randomly selecting four blocks as a module 1, a module 2, a module 3 and a module 4 according to the sample diagram for making the identification chart given in the figure 2, and reserving middle blank parts as painting areas; step 3, manufacturing corresponding splicing graphs according to nine verification modes given in the table I to be used as verification identification graphs; step 4, in the Unity project, verifying the identification diagram making mode provided by the invention; and step 5, testing whether the identification map is available or not by using a verification project through the identification map, and recording the result to obtain the feasibility of quickly and stably manufacturing the AR painting identification map provided by the method. When the color-coated identification picture is manufactured, the same condition of the same side module picture does not occur on different identification pictures; the middle blank part (non-recognition area) is controlled within 30% -50% as much as possible (the larger the blank part is, the higher the requirement on the frame module diagram is), and the suggested blank part is controlled to be about 40%; except for the blank part, the characteristic points on the four-block frame module graph are more and cannot be monotonously repeated patterns; too many characteristic points are not needed at the boundary of the blank part and the boundary of the frame module diagram as far as possible; the shape of the middle margin portion has little influence on recognition (the margin portion is rectangular, circular or elliptical in shape, and has little influence on recognition when tested).
As shown in fig. 3, in an embodiment, there is provided a display system of an augmented reality-based paint color recognition map, including:
the system comprises a scanning module 1, a processing module and a processing module, wherein the scanning module is used for scanning a painting identification picture to obtain a scanning picture corresponding to the painting identification picture, and the painting identification picture comprises a plurality of feature points which can be identified by an augmented reality technology;
the extraction module 2 is used for extracting the characteristic points in the scanning image;
the processing module 3 is used for performing augmented reality processing on the extracted feature points to acquire a matching model corresponding to the feature points;
and the synthesis module 4 is used for carrying out virtual reality image synthesis on the matching model and the scanogram and sending the synthesized image to the mobile terminal for display.
As shown in fig. 4, before the module 1 is scanned, the method further includes: and the manufacturing module 5 is used for manufacturing a painting identification picture.
The production module 5 is specifically configured to:
selecting a first number of identification graphs with the same size and different patterns;
randomly selecting a second number of recognition images from the recognition images as background images;
building a verification project by taking Unity as a verification tool;
verifying the background image through a verification project to obtain a verification result;
and splicing the background images according to the verification result, and leaving white in the middle as a painting area to obtain a painting identification image.
The background image is provided with a plurality of characteristic points which can be identified by the augmented reality technology, and the background image is a non-monotone repeated pattern.
The area of the painting area accounts for 30-50% of the proportion range of the painting identification diagram.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (6)
1. A method for displaying a painting identification picture based on augmented reality is characterized by comprising the following steps:
s1, scanning the color painting identification picture to obtain a scanning picture corresponding to the color painting identification picture, wherein the color painting identification picture comprises a plurality of feature points which can be identified by the augmented reality technology;
s2, extracting the characteristic points in the scanning image;
s3, performing augmented reality processing on the extracted feature points to obtain matching models corresponding to the feature points;
s4, synthesizing the virtual reality image of the matching model and the scanogram, and sending the synthesized image to a mobile terminal for display;
before the step S1, the method further includes:
s0, making the painting identification picture;
step S0 specifically includes:
s101, selecting a first number of identification graphs with the same size and different patterns;
s102, randomly selecting a second number of identification images from the identification images as background images;
s103, taking the Unity as a verification tool to build a verification project;
s104, verifying the background image through the verification engineering to obtain a verification result;
and S105, splicing the background image according to the verification result, and taking the middle margin as a painting area to obtain the painting identification image.
2. The method as claimed in claim 1, wherein the background map has a plurality of feature points recognizable by augmented reality technology, and the background map has a non-monotone repeating pattern.
3. The method for displaying the painting color recognition graph based on the augmented reality according to claim 1 or 2, wherein the area of the painting color area accounts for 30% -50% of the proportion range of the painting color recognition graph.
4. A display system for an augmented reality-based paint color identification map, comprising:
the system comprises a scanning module (1) and a processing module, wherein the scanning module is used for scanning a painting identification picture to obtain a scanning picture corresponding to the painting identification picture, and the painting identification picture comprises a plurality of feature points which can be identified by an augmented reality technology;
the extraction module (2) is used for extracting the characteristic points in the scanning image;
the processing module (3) is used for carrying out augmented reality processing on the extracted feature points and acquiring a matching model corresponding to the feature points;
the synthesis module (4) is used for carrying out virtual reality image synthesis on the matching model and the scanogram and sending the synthesized image to a mobile terminal for display;
further comprising: the manufacturing module is used for manufacturing the painting identification picture;
the manufacturing module is specifically configured to:
selecting a first number of identification graphs with the same size and different patterns;
randomly selecting a second number of recognition images from the recognition images as background images;
building a verification project by taking Unity as a verification tool;
verifying the background image through the verification engineering to obtain a verification result;
and splicing the background images according to the verification result, and leaving white in the middle as a painting area to obtain the painting identification image.
5. The system for displaying the augmented reality-based color recognition map according to claim 4, wherein the background map is provided with a plurality of feature points recognizable by augmented reality technology, and the background map is a non-monotonously repeated pattern.
6. The display system of the color recognition map based on the augmented reality according to claim 4 or 5, wherein the area of the color region occupies a proportion range of 30% -50% of the color recognition map.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710136594.2A CN107025674B (en) | 2017-03-08 | 2017-03-08 | Method and system for displaying painting identification picture based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710136594.2A CN107025674B (en) | 2017-03-08 | 2017-03-08 | Method and system for displaying painting identification picture based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107025674A CN107025674A (en) | 2017-08-08 |
| CN107025674B true CN107025674B (en) | 2020-08-18 |
Family
ID=59526125
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710136594.2A Active CN107025674B (en) | 2017-03-08 | 2017-03-08 | Method and system for displaying painting identification picture based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107025674B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104665529A (en) * | 2015-02-13 | 2015-06-03 | 南通明德塑胶有限公司 | Mental development intelligent early education ground mat and identification method thereof |
| CN204979778U (en) * | 2015-09-30 | 2016-01-20 | 淄博汇佰宗工贸有限公司 | Children article packing carton |
| CN105844979A (en) * | 2015-12-15 | 2016-08-10 | 齐建明 | Augmented reality book, and education system and method based on augmented reality book |
| CN106406542A (en) * | 2016-11-04 | 2017-02-15 | 杭州阿优智能科技有限公司 | Method, system and equipment for generating content of augmented reality |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130300061A1 (en) * | 2011-11-21 | 2013-11-14 | Ariel BEN EZRA | Three dimensional puzzle with interactive features |
| US10068547B2 (en) * | 2012-06-29 | 2018-09-04 | Disney Enterprises, Inc. | Augmented reality surface painting |
| JP2014149712A (en) * | 2013-02-01 | 2014-08-21 | Sony Corp | Information processing device, terminal device, information processing method, and program |
| KR20150109960A (en) * | 2014-03-21 | 2015-10-02 | 최종일 | System for displaying augmented reality |
| CN105653036A (en) * | 2015-12-31 | 2016-06-08 | 深圳市路通网络技术有限公司 | Scrawling augmented reality method and system |
| CN106204746B (en) * | 2016-06-23 | 2018-06-19 | 广州增强信息科技有限公司 | A kind of augmented reality system of achievable 3D models live paint |
| CN106127859B (en) * | 2016-06-28 | 2018-08-24 | 华中师范大学 | A kind of mobile augmented reality type scribble paints the sense of reality generation method of sheet |
| CN105931506B (en) * | 2016-07-12 | 2019-02-12 | 大连新锐天地传媒有限公司 | A kind of children based on augmented reality tint system and its display methods |
| CN106297479A (en) * | 2016-08-31 | 2017-01-04 | 武汉木子弓数字科技有限公司 | A kind of song teaching method based on AR augmented reality scribble technology and system |
-
2017
- 2017-03-08 CN CN201710136594.2A patent/CN107025674B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104665529A (en) * | 2015-02-13 | 2015-06-03 | 南通明德塑胶有限公司 | Mental development intelligent early education ground mat and identification method thereof |
| CN204979778U (en) * | 2015-09-30 | 2016-01-20 | 淄博汇佰宗工贸有限公司 | Children article packing carton |
| CN105844979A (en) * | 2015-12-15 | 2016-08-10 | 齐建明 | Augmented reality book, and education system and method based on augmented reality book |
| CN106406542A (en) * | 2016-11-04 | 2017-02-15 | 杭州阿优智能科技有限公司 | Method, system and equipment for generating content of augmented reality |
Non-Patent Citations (2)
| Title |
|---|
| "Live Texturing of Augmented Reality Characters from Colored Drawings";Stéphane Magnenat et al;《IEEE Transactions on Visualization and Computer Graphics》;20151115;第21卷(第11期);第1201-1210页 * |
| "增强现实（AR）技术的教育应用综述";蔡苏 等;《远程教育杂志》;20160920(第5期);第27-40页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107025674A (en) | 2017-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107105310B (en) | Human image replacing method and device in video live broadcast and recording and broadcasting system | |
| CN111882627B (en) | Image processing method, video processing method, apparatus, device and storage medium | |
| CN106730815B (en) | Somatosensory interaction method and system easy to realize | |
| CN106355153A (en) | Virtual object display method, device and system based on augmented reality | |
| CN105654471A (en) | Augmented reality AR system applied to internet video live broadcast and method thereof | |
| CN108389257A (en) | Threedimensional model is generated from sweep object | |
| CN111292427B (en) | Bone displacement information acquisition method, device, equipment and storage medium | |
| CN110610546B (en) | Video picture display method, device, terminal and storage medium | |
| CN112995534B (en) | Video generation method, device, equipment and readable storage medium | |
| CN106600669A (en) | Device based on variable-color fluorescent drawing board and augmented reality, and operation method | |
| CN104427230A (en) | Reality enhancement method and reality enhancement system | |
| CN105574914A (en) | Manufacturing device and manufacturing method of 3D dynamic scene | |
| CN111840999A (en) | Game education method based on three-dimensional object graph recognition | |
| KR101543287B1 (en) | Physical Movement of Object on Reality-Augmented Reality Interaction System and Implementation Method for Electronic book | |
| CN113144613B (en) | Model-based method for generating volume cloud | |
| CN107025674B (en) | Method and system for displaying painting identification picture based on augmented reality | |
| CN104933278B (en) | A kind of multi-modal interaction method and system for disfluency rehabilitation training | |
| CN111105487B (en) | Face synthesis method and device in virtual teacher system | |
| CN112070901A (en) | AR scene construction method and device for garden, storage medium and terminal | |
| CN111292234B (en) | Panoramic image generation method and device | |
| CN111655148B (en) | Heart type analysis method based on augmented reality and intelligent equipment | |
| KR101643569B1 (en) | Method of displaying video file and experience learning using this | |
| CN103985153A (en) | Method and system for simulating plant growth | |
| CN115607978A (en) | Control method and device of intelligent interaction equipment and intelligent interaction panel | |
| CN112274932A (en) | Game resource data processing method and device, storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |