CN106127859A - A kind of mobile augmented reality type scribble is painted this sense of reality and is generated method - Google Patents
A kind of mobile augmented reality type scribble is painted this sense of reality and is generated method Download PDFInfo
- Publication number
- CN106127859A CN106127859A CN201610484482.1A CN201610484482A CN106127859A CN 106127859 A CN106127859 A CN 106127859A CN 201610484482 A CN201610484482 A CN 201610484482A CN 106127859 A CN106127859 A CN 106127859A
- Authority
- CN
- China
- Prior art keywords
- model
- texture
- scribble
- dimensional
- line frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Generation (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention belongs to mobile augmented reality technical field, the sense of reality providing a kind of mobile enhancement mode scribble to paint this generates method, including: (1) grain design, for designing the three-dimensional model that strengthens before pickup, the stricture of vagina reason of rear display, (2) three-dimensional enhancing modelling, for designing the geometric model of the actor model of scribble object and making the UV exhibition figure of actor model, (3) summit Shader design, by Shader program, by camera collection to image sequence in paint this image, through projection, conversion, the series of processing steps such as rasterisation, make the display of model after pickup truer.The present invention can extend scribble and paint this selection range, and the three-dimensional that can solve elongate member innovatively strengthens normal illumination and the visual effect that models show has, and sets up a kind of mobile augmented reality type scribble and paints the method that this sense of reality generates.
Description
Technical field
The invention belongs to mobile augmented reality technical field, paint this more particularly, to a kind of mobile enhancement mode scribble
Sense of reality generates method.
Background technology
Augmented reality (Augmented Reality, AR) technology can realize the seamless company of real world and virtual world
Knot, along with the combination of the lifting of mobile terminal computing capability, the integrated use of various sensing module, AR technology and mobile technology,
Achieve miniaturization and the portability of AR, people can be met for interactive, instantaneity, personalized demand.
Plane publication is a kind of classical education resource, by AR technology, can give its more digital content, entirely
New Interactive Experience mode can more effectively reader.Currently emerge in large numbers a series of and plane publication class AR product, such as religion
Educate card, paint this and teaching material etc..It is originally the most typical class child's AR product that the scribble combined with game of tinting is painted,
Compare tradition scribble books, child, by intelligent terminal, places oneself in the midst of in be coated with scene, meet make, with soon, use ear
Listen, the diversification education ideas thought of requiring mental skill.But this kind of painting originally there is also following defect: (1) is limited by UV exhibition figure, and AR identifies figure
Usually require that the object avoiding selecting elongated shape, and the mode using simple picture draws object, which limits publication more
The range of choice；(2) the black border line of identification figure is often mapped to model, and after causing colouring, model there will be black surround or black
Speckle effect, produces bad visual effect；(3) by identifying that figure replaces the model texture preset, if do not made special handling, illumination is imitated
The sense of reality of fruit is not enough, needs to design special tinter (Shader), thus improves the display effect of AR model.
Summary of the invention
For disadvantages described above or the Improvement requirement of prior art, the invention provides a kind of mobile augmented reality type scribble and paint
This sense of reality generates method, it is intended that by grain design, the three-dimensional design strengthening model and based on summit
Shader designs, it is possible to extension scribble paints this selection range, and the three-dimensional that can solve elongate member innovatively strengthens mould
Type shows the normal illumination and visual effect having, and sets up a kind of mobile augmented reality type scribble and paints the side that this sense of reality generates
Method.
It is an object of the invention to be realized by techniques below measure.
A kind of mobile augmented reality type scribble is painted this sense of reality and is generated method, comprises the steps:
(1) grain design, the three-dimensional line frame graph strengthening model of design scribble object, generate for three-dimensional after superposition background information
Strengthen the initial texture picture that model initially shows；Allowing child daubing picture is formed after this initial texture picture amendment form, as
Scribble is painted the one page in this and is existed, and strengthens model pickup for three-dimensional after allowing child daubing；
(2) three-dimensional enhancing modelling, designs actor model corresponding with object of scribbling in 3D modeling software is such as 3dsmax, logical
The mode crossing Polygon completes the structure of geometric model, and Polygon modeling pattern can be expressed and have complexity by less number
The model of structure, makes the UV exhibition figure of this geometric model；Initial texture picture is imported in modeling software, UV is opened up figure and puts
In the corresponding position of line frame graph on initial texture picture, and inwardly adjust apex coordinate along the outline of line frame graph
Position, the revised UV exhibition figure of this geometric model that completes；Obtain the three-dimensional increasing with initial texture being corrected simultaneously
Strong model；
(3) move AR application pickup child and paint the texture scribbled in the line frame graph of scribble object on this at scribble, by this texture
It is assigned to strengthen model with the three-dimensional of initial texture, replaces texture before colouring, be shown to the surface of model, after generating with pickup
The three-dimensional of texture strengthens model；
(4) summit Shader design, use vertex type Shader, by camera collection to image sequence in scribble paint
Image in basis, after treatment, generates texture after the pickup with true illumination sense, is assigned to this texture with initial texture
Three-dimensional strengthen model, be shown to the surface of model, generate and realistic three-dimensional strengthen model, solve actor model colouring
The situation that rear illumination is abnormal.
In technique scheme, grain design described in step (1) specifically includes following steps:
(1-1) drawing three-dimensional strengthens the line frame graph of model, according to painting the requirement of this content, at image processing software, as
In PhotoShop, design and edit model line frame graph, for the ease of painting this publication, this model line block diagram the ratio of width to height is 4:3, chi
Very little being set as 4266*3200 pixel, color mode is CMYK, and file memory format is * .jpg；
Opening up figure work for convenience of the UV of actor model in next step, the design of this line frame graph need to be handled as follows:
(1-1-1) line frame graph need not too much show the details position of model object, adheres to terseness principle；
(1-1-2) line frame graph outer most edge sideline thickness controls at 15-20 pixel value, unsuitable meticulous, and the internal lines of line frame graph are thick
Thin not higher than 5 pixel values, should not be the thickest；
(1-1-3) line frame graph inner wire interspace is maintained at more than 30 pixel values；
(1-1-4), when inside line frame graph, less closed area, i.e. closed area are less than 10*10 pixel, such as tooth, this region is preset
Color texture；
(1-2) add line frame graph background information, the line frame graph of scribble object is superimposed upon in related background information, generate three-dimensional and increase
The initial texture picture of strong model；Form allowing child daubing picture after this initial texture picture amendment form, paint in this as scribble
One page exist, use for registration step in augmented reality, this version specific requirement: a size of 1024*768, color mode
For RGB, bit depth is 24, and file memory format is * .jpg, and this allowing child daubing picture is also that dinosaur three-dimensional strengthens model simultaneously
Identify picture；
Strengthen the identification picture of model as three-dimensional, this picture need to provide enough identification informations, to facilitate photographic head to carry out figure
Detection and extraction as eigenvalue.Background information need to be handled as follows:
(1-2-1) backcolor keeps good contrast；
(1-2-2) background patterns keeps complicated clearly demarcated profile；
(1-2-3) background patterns ensures a number of sharp features point；
(1-2-4) background information is without repeat pattern, refers specifically to the region same specification in blocks do not occur, such as meadow and sky
Empty.
In technique scheme, step (2) makes when UV exhibition is schemed according to model geometric form, according to different shapes
Separate including plane, cylindricality, spherical, rectangle etc., model is deployed on two dimensional surface, it is achieved the top of each geometric surface
Point is corresponding with UV coordinate.Concrete UV exhibition figure process need to be done and process as follows:
(2-2-1) UV puts and keeps smooth vertical and horizontal, to reduce the sawtooth quantity that UV pinup picture produces；
(2-2-2) UV seam avoids the occurrence of in the obvious part of model, and seam both sides element keeps consistent；
(2-2-3) stretching and two kinds of processing modes of cutting knife of UV use flexibly.Model main portions UV adjusts and adheres to that " cutting knife is
Main, be stretched as auxiliary " principle, secondary position UV adjusts the principle adhering to " being stretched as main, cutting knife is auxiliary "；
(2-2-4) UV coordinate is avoided being pressed onto line frame graph in initial texture picture and is i.e. scribbled the border of object, simultaneously along line frame graph
Outline inwardly adjust the position of apex coordinate, adjustment amplitude controls more than 8 pixel values；
(2-2-5) shape excessively narrow positions drawn by the line of line frame graph, when i.e. minimum inner distance is less than 50 pixel value, does not deposit UV
Coordinate, such as dental area.Similar narrow positions answers prefabricated texture, or obtains texture nearby.
In technique scheme, the design of summit Shader described in step (4) specifically includes following steps
(4-1) data input, using camera collection to image sequence in scribble paint the information of tinting on this as sampling stricture of vagina
Manage incoming Shader；Including scribble the vertex data i.e. vertex position of actor model of object, data texturing i.e. colouring information；
(4-2), when the ratio of width to height of sample texture is consistent with the ratio of width to height of display terminal screen, sample texture does not carry out cutting；Sampling
When the ratio of width to height of texture is inconsistent with the ratio of width to height of display terminal screen, cropping a part of picture in screen, cutting principle is:
When the ratio of width to height of sample texture is less than the ratio of width to height of screen, the content of sample texture preferentially symmetrical cutting upper and lower end；Sample texture
The ratio of width to height more than the ratio of width to height of screen time, sample texture preferentially symmetrical crop left, the content of right-hand member；
(4-3) obtain the combined transformation matrix MVP of the allowing child daubing picture after scribble, obtain the top of the actor model of scribble object
The point coordinates two-dimentional window coordinates after MVP matrixing；
(4-4) use standardization that these two dimension window coordinates transform to [0,1] interval, then it is high to be multiplied by screen width respectively, obtains angle
The pixel coordinate of the real screen of color model, after translation transformation, allows the initial point of pixel coordinate and the initial point of screen obtained
Alignment；
(4-5) application meets the surroundings of mobile display termination property, carries out photo-irradiation treatment, and process is as follows:
(4-5-1) state basic render pipeline, in 3 D image drawing, need according to illumination model, select correct rendering
Passage, each pixel calculating visible oBject surface invests the brightness of observer.Forward is used to render the place of foundation channel
Reason mode so that directional light is rendered with per-pixel lighting pattern, reaches the effect of true illumination；
(4-5-2) vertex program, for obtaining the priming color on summit, the i.e. light source impact on this summit；
(4-5-2-1) diffuse-reflectance processes；Irreflexive vector diffuse, by incident vector L and each vertex position of light source
Normal vector N determine, incident vector refers to the light intensity that diffuse reflector and ambient light reflect alternately, and computing formula is:
diffuse=L·N
This process is that vector L Yu N carries out dot product, and its process is:
diffuse=|L|*|N|*cos∠(L,N)
According to computing formula, need to obtain the normal vector N of vertex position, and change its normal, the conversion to normal needs
Use and converse put matrix, it is achieved normal is tied to the conversion of object coordinates system from world coordinates, and concrete transformation process is as follows:
Realize being multiplied of normal and matrix by mul function, obtain the normal vector in object coordinates system, by its unitization after,
Normal vector N to vertex position；
Cos ∠ (L, N) in formula is equivalent to dot (N, L), will the unit vector of vertex scheme vector and light in object coordinates system
The incident vector in source, carries out dot product operations by dot function, returns two vectorial scalar products；For avoiding light and shade Sudden change region
Produce strange phenomenon, then processed by max (0, dot (N, L)) function；By the diffuse-reflectance amount obtained and directional light
Colouring information is multiplied, and obtains the diffuse-reflectance result on summit；
(4-5-2-2) utilize spherical harmonic function that diffuse-reflectance result is carried out ambient light process, by the place to ambient light
Reason promotes the verity of graphic hotsopt；Spherical harmonic function belongs to radiation environment chart pasting method, can be used for generating soft environment
Illumination, amount of calculation is less than Environment, is suitable for dynamic environment, promotes the sense of reality of figure；
(4-5-2-3) after ambient light processes, the vertex color information of output carries out interpolation generation pixel, then is imparted to sheet unit journey
Sequence calculates；
(4-5-3) fragment program, output display after acquired vertex color information is processed；Concrete implementation method is such as
Under:
(4-5-3-1) by acquired vertex color information, show that the sample texture after cutting i.e. samples main texture in three-dimensional
Color value under coordinate；
(4-5-3-2) it is smooth variation and the hatching gradient effect of illumination simulation, intensity and the decay of light source need to be calculated,
Mainly the intensity of directional light and the intensity of ambient light are carried out interpolation calculation, obtain intensity and the dampening information of light source；Will
Main texture color value under three-dimensional coordinate of sampling carries out dot product with intensity and the dampening information of light source；If model colour brightness
Excessive or too small, the true display of illumination model, the situation the darkest for improving this models show will be affected, scaling need to be multiplied by
Parameter regulates colour brightness, and this parameter range of accommodation is at 0-5, thus obtains the sampling main texture final face under three-dimensional coordinate
Colour；
(4-5-3-3) after coordinate transform and photo-irradiation treatment, summit is projected as two-dimensional coordinate and depth information；GPU passes through
Rasterization process generates new summit, and each attribute of opposite vertexes carries out linear interpolation, generates the final UV of actor model, position
Putting and color value, the stereovision of model is truer.
The invention provides a kind of sense of reality realizing mobile augmented reality type allowing child daubing and generate method, it is possible to reduce and be coated with
Crow is painted this selection and limits, and overcomes tradition UV exhibition figure mode and the black surround or the black speck that occur on actor model after the colouring that occurs are existing
As；Provide a kind of special Shader based on summit design, create for actor model after showing colouring on multiple mobile terminal
If good lighting effect.
Accompanying drawing explanation
Fig. 1 is the flow chart of steps of the inventive method.
Fig. 2 is that the dinosaur wire frame in the present embodiment is drawn.
Fig. 3 is the initial texture picture formed after dinosaur line frame graph superposition background information.
Schematic diagram when Fig. 4 is that in the present embodiment, UV exhibition figure does not adjusts.
Fig. 5 is the schematic diagram in the present embodiment after the adjustment of UV exhibition figure.
Detailed description of the invention
In order to make the purpose of the present invention, technical scheme and advantage clearer, below in conjunction with accompanying drawing and case study on implementation,
The present invention is further elaborated.Should be appreciated that and described herein be embodied as case only in order to explain this
Bright, it is not intended to limit the present invention.Additionally, technical characteristic involved in each embodiment of invention described below
As long as the conflict of not constituting each other just can be mutually combined.
The sense of reality of mobile augmented reality type allowing child daubing of the present invention generates method, as it is shown in figure 1, include grain design,
Three-dimensional enhancing modelling and summit Shader design.
Grain design, the three-dimensional line frame graph strengthening model of design scribble object, generate for three after superposition background information
Dimension strengthens the initial texture picture that model initially shows；Form allowing child daubing picture after this initial texture picture amendment form, make
Paint the one page in this for scribble to exist, after allowing child daubing, strengthen model pickup for three-dimensional.According to painting the requirement of this content, at figure
As processing in software such as PhotoShop, design and edit line frame graph, line frame graph is superimposed upon in related background information；During use,
Mobile AR application pickup child paints the texture scribbled in the line frame graph of scribble object on this at scribble, this texture is assigned to
The three-dimensional of initial texture strengthens model, replaces texture before colouring, is shown to the surface of model, generates with after pickup the three of texture
Dimension strengthens model.
Three-dimensional enhancing modelling, designs actor model corresponding with object of scribbling in 3D modeling software is such as 3dsmax,
By the way of Polygon, complete the structure of geometric model, then initial texture picture is imported in modeling software；Then basis
The geometric shape of geometric model separates, by geometric model according to different shapes such as plane, cylindricality, spherical, rectangle etc.
It is deployed on two dimensional surface, it is achieved the summit of each geometric surface is corresponding with UV coordinate, makes the UV exhibition figure of this geometric model；For
Break through scribble to paint this selection and limit, and can eliminate strengthen model pickup after the black surround that occurs or black speck phenomenon, UV is opened up and schemes
In the corresponding position of line frame graph being placed on initial texture picture, and inwardly adjust summit along the outline of line frame graph and sit
Target position, the revised UV exhibition figure of this geometric model that completes；Simultaneously obtain be corrected with the three of initial texture
Dimension strengthens model.
Summit Shader designs, it is achieved three-dimensional enhancing model sense of reality lighting simulation after texture picks up.According to texture
The practical situation of flow process pickup step, uses the Shader of vertex type here, and main contents include two parts, i.e. summit journey
Sequence and fragment program.Vertex program is the core content of Shader, by camera collection to image sequence in scribble paint this
On image, after projection, conversion, rasterising step process, generate and there is texture after the pickup of true illumination sense, by this stricture of vagina
Reason is assigned to strengthen model with the three-dimensional of initial texture, is shown to the surface of model, generates realistic three-dimensional enhancing mould
Type.
Sense of reality by dinosaur model describes in detail as a example by generating below.
See Fig. 2, according to the requirement painted in this scripting documents about dinosaur content, utilize image processing software
Photoshop design and editor's dinosaur line frame graph.For ease of painting this publication, picture the ratio of width to height is 4:3, saves as * .jpg form.
See Fig. 3, dinosaur line frame graph is superimposed upon in related background information, generate the initial texture picture of dinosaur model.
Form allowing child daubing picture after this initial texture picture amendment form, paint the one page in this as scribble and exist, through allowing child daubing
Model pickup is strengthened afterwards for three-dimensional；This allowing child daubing picture is also the identification picture that dinosaur three-dimensional strengthens model simultaneously, needs to provide
Enough identification informations, to facilitate photographic head to carry out detection and the extraction of image feature value.In actual application, this background information should
Meet and require as follows:
(1-2-1) backcolor keeps good contrast；
(1-2-2) background patterns keeps complicated clearly demarcated profile；
(1-2-3) background patterns ensures a number of sharp features point；
(1-2-4) background information is without repeat pattern, refers specifically to the region same specification in blocks do not occur, such as meadow and sky
Empty.
Child can paint the line frame graph i.e. line of this picture dinosaur and draw shape area and scribble random color.During use, mobile
Pickup child is painted dinosaur and draws, according to line, the color that shape is scribbled on this by AR application, and the color being coated with in the plane will be assigned to probably
Dragon is three-dimensional strengthens model, and it, by texture before replacement colouring, is shown to dinosaur three-dimensional and strengthens the surface of model.
Paint the requirement of the design according to dinosaur, in 3D modeling software 3dsmax, by the way of Polygon, complete dinosaur
The structure of geometric model, and initial texture picture is imported in 3dsmax Materials Library.Then according to dinosaur model geometric form
Separate according to different shapes, dinosaur model is deployed on two dimensional surface, it is achieved the summit of each geometric surface is sat with UV
Target is corresponding.See Fig. 4, UV editing machine shows the dinosaur initial texture picture of importing, the UV exhibition figure just obtained is put
In the position of this texture picture line frame graph, it is to avoid be pressed onto the border of line frame graph.Now dinosaur three-dimensional strengthens model pickup youngster
After drawing, according to dinosaur line, the color that shape is scribbled in Tong Hui basis, there is black surround or black speck phenomenon in model.
The selection painting this in order to break through scribble limits, and can eliminate dinosaur strengthen the black surround occurred after model pickup texture or
Black speck phenomenon, need to inwardly adjust the position of UV apex coordinate along the outline of dinosaur line frame graph, and Adjustment effect sees Fig. 5.
After adjustment, black surround or the black speck phenomenon of dinosaur three-dimensional enhancing model are eliminated.
Strengthen model sense of reality lighting simulation after texture picks up for realizing dinosaur, improve what fixing rendering pipeline existed
Render limitation problem, according to the practical situation of texture flow process pickup step, use the Shader of vertex type here, process top
Point transformation, illumination and processes pixel stage.Summit Shader main contents include two parts, i.e. vertex program and sheet unit journey
Sequence.What vertex program processed is summit, is the core content of Shader, and the dinosaur on the image sequence of camera collection is painted this
Picture, processes step through projection, conversion etc., generates texture after the dinosaur model pickup with true illumination sense, by this texture
It is assigned to strengthen model with the three-dimensional of initial texture, is shown to the surface of model, generates realistic dinosaur three-dimensional and strengthen
Model.
Claims (4)
1. a mobile augmented reality type scribble is painted sense of reality originally and is generated method, it is characterised in that the method includes walking as follows
Rapid:
(1) grain design, the three-dimensional line frame graph strengthening model of design scribble object, generate for three-dimensional after superposition background information
Strengthen the initial texture picture that model initially shows；Allowing child daubing picture is formed after this initial texture picture amendment form, as
Scribble is painted the one page in this and is existed, and strengthens model pickup for three-dimensional after allowing child daubing；
(2) three-dimensional enhancing modelling, designs actor model corresponding with object of scribbling in 3D modeling software, passes through
The mode of Polygon completes the structure of geometric model, makes the UV exhibition figure of this geometric model；Import to build by initial texture picture
In mould software, UV is opened up in the corresponding position of line frame graph that figure is placed on initial texture picture, and along the lines of line frame graph
Profile inwardly adjusts the position of apex coordinate, the revised UV exhibition figure of this geometric model that completes；Obtain simultaneously and be corrected
Strengthen model with the three-dimensional of initial texture；
(3) move AR application pickup child and paint the texture scribbled in the line frame graph of scribble object on this at scribble, by this texture
It is assigned to strengthen model with the three-dimensional of initial texture, replaces texture before colouring, be shown to the surface of model, after generating with pickup
The three-dimensional of texture strengthens model；
(4) summit Shader design, use vertex type Shader, by camera collection to image sequence in scribble paint
Image in basis, after projection, conversion, rasterising step process, generates texture after the pickup with true illumination sense, should
Texture is assigned to strengthen model with the three-dimensional of initial texture, is shown to the surface of model, generates realistic three-dimensional enhancing
Model.
Mobile augmented reality type the most according to claim 1 scribble is painted this sense of reality and is generated method, it is characterised in that step
Suddenly grain design described in (1) specifically includes following steps:
(1-1) drawing three-dimensional strengthens the line frame graph of model, in image processing software, and design and edit model line frame graph, this mould
Molded line block diagram the ratio of width to height is 4:3, is dimensioned so as to 4266*3200 pixel, and color mode is CMYK, and file memory format is *
.jpg；
The design of this model line block diagram need to be handled as follows:
(1-1-1) line frame graph outer most edge sideline thickness controls at 15-20 pixel value, and the internal line weight of line frame graph is not higher than 5
Individual pixel value；
(1-1-2) line frame graph inner wire interspace is maintained at more than 30 pixel values；
(1-1-3) when inside line frame graph, less closed area, i.e. closed area are less than 10*10 pixel, this region preset color stricture of vagina
Reason；
(1-2) add line frame graph background information, the line frame graph of scribble object is superimposed upon in related background information, generate three-dimensional and increase
The initial texture picture of strong model；Allowing child daubing picture, specific requirement: a size of is formed after this initial texture picture amendment form
1024*768 pixel, color mode is RGB, and bit depth is 24, and file memory format is * .jpg.
Mobile augmented reality type the most according to claim 1 scribble is painted this sense of reality and is generated method, it is characterised in that step
Require when (2) make UV exhibition figure suddenly: UV coordinate is avoided being pressed onto line frame graph in initial texture picture and scribbled the border of object, with
Time inwardly adjust the position of apex coordinate along the outline of line frame graph, adjustment amplitude controls more than 8 pixel values；Line
Shape excessively narrow positions drawn by the line of block diagram, when i.e. minimum inner distance is less than 50 pixel value, does not deposit UV coordinate.
Mobile augmented reality type the most according to claim 1 scribble is painted this sense of reality and is generated method, it is characterised in that step
Suddenly the design of summit Shader described in (4) includes two parts, i.e. vertex program and fragment program；Specifically include following steps
(4-1) data input, using camera collection to image sequence in scribble paint the information of tinting on this as sampling stricture of vagina
Manage incoming Shader；Including scribble the vertex data i.e. vertex position of actor model of object, data texturing i.e. colouring information；
(4-2), when the ratio of width to height of sample texture is consistent with the ratio of width to height of display terminal screen, sample texture does not carry out cutting；Sampling
When the ratio of width to height of texture is inconsistent with the ratio of width to height of display terminal screen, cropping a part of picture in screen, cutting principle is:
When the ratio of width to height of sample texture is less than the ratio of width to height of screen, the content of sample texture preferentially symmetrical cutting upper and lower end；Sample texture
The ratio of width to height more than the ratio of width to height of screen time, sample texture preferentially symmetrical crop left, the content of right-hand member；
(4-3) obtain the combined transformation matrix MVP of the allowing child daubing picture after scribble, obtain the top of the actor model of scribble object
The point coordinates two-dimentional window coordinates after MVP matrixing；
(4-4) use standardization that these two dimension window coordinates transform to [0,1] interval, then it is high to be multiplied by screen width respectively, obtains angle
The pixel coordinate of the real screen of color model, after translation transformation, allows the initial point of pixel coordinate and the initial point of screen obtained
Alignment；
(4-5) application meets the surroundings of mobile display termination property, carries out photo-irradiation treatment, and process is as follows:
(4-5-1) state basic render pipeline, select the processing mode using forward to render foundation channel；
(4-5-2) vertex program, for obtaining the priming color on summit, the i.e. light source impact on this summit；
Define a vertex position comprising actor model and the structure of color vector, as input information, use position, summit
Put the variable of mark, the positional information of storage object, with the variable of color vector mark, access the vertex color of object
(4-5-2-1) diffuse-reflectance processes；Irreflexive vector diffuse, by incident vector L and each vertex position of light source
Normal vector N determine, computing formula is:
diffuse=L·N
This process is that vector L Yu N carries out dot product, and its process is:
diffuse=|L|*|N|*cos∠(L,N)
According to computing formula, need to obtain the normal vector N of vertex position, and change its normal, the conversion to normal needs
Use and converse put matrix, it is achieved normal is tied to the conversion of object coordinates system from world coordinates, and concrete transformation process is as follows:
Realize being multiplied of normal and matrix by mul function, obtain the normal vector in object coordinates system, by its unitization after,
Normal vector N to vertex position；
Cos ∠ (L, N) in formula is equivalent to dot (N, L), will the unit vector of vertex scheme vector and light in object coordinates system
The incident vector in source, carries out dot product operations by dot function, returns two vectorial scalar products；Again by max (0, dot (N,
L)) function processes；The diffuse-reflectance amount of acquisition being multiplied with the colouring information of directional light, the diffuse-reflectance obtaining summit processes knot
Really；
(4-5-2-2) use radiation environment chart pasting method that diffuse-reflectance result is carried out ambient light process；
(4-5-2-3) after ambient light processes, the vertex color information of output carries out interpolation generation pixel, then is imparted to sheet unit journey
Sequence calculates；
(4-5-3) fragment program, output display after acquired vertex color information is processed；Concrete implementation method is such as
Under:
(4-5-3-1) by acquired vertex color information, show that the sample texture after cutting i.e. samples main texture in correspondence
Three-dimensional coordinate under color value；
(4-5-3-2) calculate intensity and the decay of light source, the intensity of directional light and the intensity of ambient light carried out interpolation calculation,
Obtain intensity and the dampening information of light source；By the main texture color value under the corresponding three-dimensional coordinate intensity with light source of sampling
And dampening information carries out dot product；Being multiplied by zooming parameter again to regulate colour brightness, this parameter range of accommodation is at 0-5, thus obtains
Must sample main texture final color value under corresponding three-dimensional coordinate；
(4-5-3-3) after coordinate transform and photo-irradiation treatment, summit is projected as 2D coordinate and depth information；GPU passes through light
Gated processes and generates new summit, and each attribute of opposite vertexes carries out linear interpolation, generates the final UV of actor model, position
And color value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610484482.1A CN106127859B (en) | 2016-06-28 | 2016-06-28 | A kind of mobile augmented reality type scribble paints the sense of reality generation method of sheet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610484482.1A CN106127859B (en) | 2016-06-28 | 2016-06-28 | A kind of mobile augmented reality type scribble paints the sense of reality generation method of sheet |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106127859A true CN106127859A (en) | 2016-11-16 |
| CN106127859B CN106127859B (en) | 2018-08-24 |
Family
ID=57267030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610484482.1A Active CN106127859B (en) | 2016-06-28 | 2016-06-28 | A kind of mobile augmented reality type scribble paints the sense of reality generation method of sheet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106127859B (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106600669A (en) * | 2016-12-22 | 2017-04-26 | 郑州正电电子技术有限公司 | Device based on variable-color fluorescent drawing board and augmented reality, and operation method |
| CN106599919A (en) * | 2016-12-13 | 2017-04-26 | 毛荣军 | Fabrication method and display method of augmented reality diamond painting |
| CN106803285A (en) * | 2016-11-30 | 2017-06-06 | 上海仙剑文化传媒股份有限公司 | A kind of self-defined orientation generation method and device of AR books |
| CN106815885A (en) * | 2016-12-21 | 2017-06-09 | 北京农业信息技术研究中心 | A kind of popular science knowledge interaction display method and device |
| CN106843473A (en) * | 2016-12-30 | 2017-06-13 | 武汉市马里欧网络有限公司 | Children based on AR tint system and method |
| CN107025674A (en) * | 2017-03-08 | 2017-08-08 | 武汉秀宝软件有限公司 | A kind of display methods and system of the identification figure of tinting based on augmented reality |
| CN107347116A (en) * | 2017-06-30 | 2017-11-14 | 北京金山安全软件有限公司 | Desktop effect generation method and device and electronic equipment |
| CN108241726A (en) * | 2016-12-23 | 2018-07-03 | 李雨暹 | Remote management method and application system for virtual information of mobile object |
| CN108509473A (en) * | 2017-08-28 | 2018-09-07 | 胜典科技股份有限公司 | It is combined from the audio-visual works system and record media for creating element with augmented reality technology |
| CN108564523A (en) * | 2018-04-12 | 2018-09-21 | 长沙景美集成电路设计有限公司 | A kind of implementation method of the arbitrary viewport transform in GPU |
| CN108765530A (en) * | 2018-05-24 | 2018-11-06 | 北京声影动漫科技有限公司 | A method of making caricature and/or 2 D animation |
| CN109801379A (en) * | 2019-01-21 | 2019-05-24 | 视辰信息科技(上海)有限公司 | General augmented reality glasses and its scaling method |
| CN109862343A (en) * | 2017-11-30 | 2019-06-07 | 宏达国际电子股份有限公司 | Virtual reality device, image treatment method and non-transient computer-readable recording medium |
| CN109883414A (en) * | 2019-03-20 | 2019-06-14 | 百度在线网络技术（北京）有限公司 | A kind of automobile navigation method, device, electronic equipment and storage medium |
| CN109903366A (en) * | 2019-03-13 | 2019-06-18 | 网易（杭州）网络有限公司 | The rendering method and device of dummy model, storage medium and electronic equipment |
| CN110163942A (en) * | 2018-07-18 | 2019-08-23 | 腾讯科技（深圳）有限公司 | A kind of image processing method and device |
| CN110611787A (en) * | 2019-06-10 | 2019-12-24 | 青岛海信电器股份有限公司 | Display and image processing method |
| CN111582281A (en) * | 2020-05-11 | 2020-08-25 | 广东小天才科技有限公司 | Picture display optimization method and device, electronic equipment and storage medium |
| CN112106127A (en) * | 2018-04-27 | 2020-12-18 | 克里赛利克斯有限公司 | Medical platform |
| CN113160395A (en) * | 2021-05-20 | 2021-07-23 | 北京知优科技有限公司 | CIM-based urban multi-dimensional information interaction and scene generation method, device and medium |
| CN113515792A (en) * | 2021-09-14 | 2021-10-19 | 深圳须弥云图空间科技有限公司 | Intelligent checking method and device for graph model |
| CN113741835A (en) * | 2020-05-29 | 2021-12-03 | 北京嗨动视觉科技有限公司 | Method and device for realizing effect of trotting horse lamp |
| CN116958332A (en) * | 2023-09-20 | 2023-10-27 | 南京竹影数字科技有限公司 | Method and system for mapping 3D model in real time of paper drawing based on image recognition |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011253512A (en) * | 2010-06-02 | 2011-12-15 | Kunio Yasuzawa | Application device of augmented reality |
| WO2015031886A1 (en) * | 2013-09-02 | 2015-03-05 | Thankavel Suresh T | Ar-book |
| CN104766354A (en) * | 2015-03-19 | 2015-07-08 | 深圳市创梦天地科技有限公司 | Method for augmented reality drawing and mobile terminal |
| CN105653036A (en) * | 2015-12-31 | 2016-06-08 | 深圳市路通网络技术有限公司 | Scrawling augmented reality method and system |
-
2016
- 2016-06-28 CN CN201610484482.1A patent/CN106127859B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011253512A (en) * | 2010-06-02 | 2011-12-15 | Kunio Yasuzawa | Application device of augmented reality |
| WO2015031886A1 (en) * | 2013-09-02 | 2015-03-05 | Thankavel Suresh T | Ar-book |
| CN104766354A (en) * | 2015-03-19 | 2015-07-08 | 深圳市创梦天地科技有限公司 | Method for augmented reality drawing and mobile terminal |
| CN105653036A (en) * | 2015-12-31 | 2016-06-08 | 深圳市路通网络技术有限公司 | Scrawling augmented reality method and system |
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106803285B (en) * | 2016-11-30 | 2021-04-20 | 上海仙剑文化传媒股份有限公司 | AR book custom orientation generation method and device |
| CN106803285A (en) * | 2016-11-30 | 2017-06-06 | 上海仙剑文化传媒股份有限公司 | A kind of self-defined orientation generation method and device of AR books |
| CN106599919A (en) * | 2016-12-13 | 2017-04-26 | 毛荣军 | Fabrication method and display method of augmented reality diamond painting |
| CN106815885A (en) * | 2016-12-21 | 2017-06-09 | 北京农业信息技术研究中心 | A kind of popular science knowledge interaction display method and device |
| CN106815885B (en) * | 2016-12-21 | 2020-06-30 | 北京农业信息技术研究中心 | Science popularization knowledge interactive display method and device |
| CN106600669A (en) * | 2016-12-22 | 2017-04-26 | 郑州正电电子技术有限公司 | Device based on variable-color fluorescent drawing board and augmented reality, and operation method |
| CN108241726A (en) * | 2016-12-23 | 2018-07-03 | 李雨暹 | Remote management method and application system for virtual information of mobile object |
| CN108241726B (en) * | 2016-12-23 | 2022-08-23 | 李雨暹 | Remote management method and application system for virtual information of mobile object |
| CN106843473B (en) * | 2016-12-30 | 2020-04-10 | 武汉市马里欧网络有限公司 | AR-based children painting system and method |
| CN106843473A (en) * | 2016-12-30 | 2017-06-13 | 武汉市马里欧网络有限公司 | Children based on AR tint system and method |
| CN107025674A (en) * | 2017-03-08 | 2017-08-08 | 武汉秀宝软件有限公司 | A kind of display methods and system of the identification figure of tinting based on augmented reality |
| CN107347116A (en) * | 2017-06-30 | 2017-11-14 | 北京金山安全软件有限公司 | Desktop effect generation method and device and electronic equipment |
| CN107347116B (en) * | 2017-06-30 | 2019-11-26 | 北京金山安全软件有限公司 | Desktop effect generation method and device and electronic equipment |
| CN108509473A (en) * | 2017-08-28 | 2018-09-07 | 胜典科技股份有限公司 | It is combined from the audio-visual works system and record media for creating element with augmented reality technology |
| CN108509473B (en) * | 2017-08-28 | 2022-07-12 | 胜典科技股份有限公司 | Video and audio works system and recording medium combining self-creation elements by augmented reality technology |
| CN109862343A (en) * | 2017-11-30 | 2019-06-07 | 宏达国际电子股份有限公司 | Virtual reality device, image treatment method and non-transient computer-readable recording medium |
| CN108564523A (en) * | 2018-04-12 | 2018-09-21 | 长沙景美集成电路设计有限公司 | A kind of implementation method of the arbitrary viewport transform in GPU |
| CN112106127A (en) * | 2018-04-27 | 2020-12-18 | 克里赛利克斯有限公司 | Medical platform |
| CN108765530A (en) * | 2018-05-24 | 2018-11-06 | 北京声影动漫科技有限公司 | A method of making caricature and/or 2 D animation |
| CN110163942A (en) * | 2018-07-18 | 2019-08-23 | 腾讯科技（深圳）有限公司 | A kind of image processing method and device |
| CN110163942B (en) * | 2018-07-18 | 2023-02-14 | 腾讯科技（深圳）有限公司 | Image data processing method and device |
| CN109801379A (en) * | 2019-01-21 | 2019-05-24 | 视辰信息科技(上海)有限公司 | General augmented reality glasses and its scaling method |
| CN109801379B (en) * | 2019-01-21 | 2023-02-17 | 视辰信息科技(上海)有限公司 | Universal augmented reality glasses and calibration method thereof |
| CN109903366A (en) * | 2019-03-13 | 2019-06-18 | 网易（杭州）网络有限公司 | The rendering method and device of dummy model, storage medium and electronic equipment |
| CN109883414A (en) * | 2019-03-20 | 2019-06-14 | 百度在线网络技术（北京）有限公司 | A kind of automobile navigation method, device, electronic equipment and storage medium |
| CN109883414B (en) * | 2019-03-20 | 2021-08-27 | 百度在线网络技术（北京）有限公司 | Vehicle navigation method and device, electronic equipment and storage medium |
| CN110611787B (en) * | 2019-06-10 | 2021-05-28 | 海信视像科技股份有限公司 | Display and image processing method |
| CN110611787A (en) * | 2019-06-10 | 2019-12-24 | 青岛海信电器股份有限公司 | Display and image processing method |
| CN111582281B (en) * | 2020-05-11 | 2023-05-16 | 广东小天才科技有限公司 | Picture display optimization method and device, electronic equipment and storage medium |
| CN111582281A (en) * | 2020-05-11 | 2020-08-25 | 广东小天才科技有限公司 | Picture display optimization method and device, electronic equipment and storage medium |
| CN113741835A (en) * | 2020-05-29 | 2021-12-03 | 北京嗨动视觉科技有限公司 | Method and device for realizing effect of trotting horse lamp |
| CN113741835B (en) * | 2020-05-29 | 2024-05-24 | 北京嗨动视觉科技有限公司 | Trotting horse lamp effect realization method and trotting horse lamp effect realization device |
| CN113160395B (en) * | 2021-05-20 | 2022-06-24 | 北京知优科技有限公司 | CIM-based urban multi-dimensional information interaction and scene generation method, device and medium |
| CN113160395A (en) * | 2021-05-20 | 2021-07-23 | 北京知优科技有限公司 | CIM-based urban multi-dimensional information interaction and scene generation method, device and medium |
| CN113515792B (en) * | 2021-09-14 | 2021-12-10 | 深圳须弥云图空间科技有限公司 | Intelligent checking method and device for graph model |
| CN113515792A (en) * | 2021-09-14 | 2021-10-19 | 深圳须弥云图空间科技有限公司 | Intelligent checking method and device for graph model |
| CN116958332A (en) * | 2023-09-20 | 2023-10-27 | 南京竹影数字科技有限公司 | Method and system for mapping 3D model in real time of paper drawing based on image recognition |
| CN116958332B (en) * | 2023-09-20 | 2023-12-22 | 南京竹影数字科技有限公司 | Method and system for mapping 3D model in real time of paper drawing based on image recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106127859B (en) | 2018-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106127859A (en) | A kind of mobile augmented reality type scribble is painted this sense of reality and is generated method | |
| US9916676B2 (en) | 3D model rendering method and apparatus and terminal device | |
| CN111508052B (en) | Rendering method and device of three-dimensional grid body | |
| CN106600712B (en) | A kind of texture replacement method based on two dimensional image | |
| US7239314B2 (en) | Method for 2-D animation | |
| CN102708585A (en) | Method for rendering contour edges of models | |
| CN107341853A (en) | Super large virtual scene and dynamic take the photograph the virtual reality fusion method and system of screen | |
| WO1998038591A9 (en) | Method for rendering shadows on a graphical display | |
| AU2019226134B2 (en) | Environment map hole-filling | |
| CN104091366B (en) | Three-dimensional intelligent digitalization generation method and system based on two-dimensional shadow information | |
| CN112700528B (en) | Virtual object shadow rendering method for head-mounted augmented reality device | |
| US11276150B2 (en) | Environment map generation and hole filling | |
| CN112819941B (en) | Method, apparatus, device and computer readable storage medium for rendering water surface | |
| CN102819855B (en) | The generation method of two dimensional image and device | |
| CN104517313B (en) | The method of ambient light masking based on screen space | |
| CN101477705B (en) | Computer assisted character animation drawing method based on light irradiated ball model | |
| CN105976423B (en) | A kind of generation method and device of Lens Flare | |
| CN108230430A (en) | The processing method and processing device of cloud layer shade figure | |
| CN112085855B (en) | Interactive image editing method, device, storage medium and computer equipment | |
| CN104240276A (en) | Screen-space-based method for simulating real skin of figure through sub-surface scattering | |
| CN114187398A (en) | Processing method and device for human body illumination rendering based on normal map | |
| Wang et al. | A method for ink-wash painting rendering for 3D scenes | |
| CN110853147B (en) | Three-dimensional face transformation method | |
| CN105869203A (en) | Pencil style processing method of 3D scene | |
| CN110136239A (en) | A method of enhancing virtual reality scenario illumination and reflection validity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |