CN109801346A - A kind of original painting neural network based auxiliary painting methods and device - Google Patents
A kind of original painting neural network based auxiliary painting methods and device Download PDFInfo
- Publication number
- CN109801346A CN109801346A CN201811561946.XA CN201811561946A CN109801346A CN 109801346 A CN109801346 A CN 109801346A CN 201811561946 A CN201811561946 A CN 201811561946A CN 109801346 A CN109801346 A CN 109801346A
- Authority
- CN
- China
- Prior art keywords
- colouring
- original
- painting
- neural network
- original painting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
Abstract
A kind of original painting auxiliary painting methods neural network based, comprising: obtain the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back, and mark the colouring parameter of each divided area of original painting, form original painting data sample；Colouring neural network model is initialized using Keras, wherein colouring neural network model uses VGG model；It imports original painting data sample and is used as training set, neural network model exercises supervision study to painting；The colouring neural network model finished using training carries out automatic colouring to the original painting line original text of input.Disclosed herein as well is corresponding original paintings neural network based to assist coloring means.Having the beneficial effect that for the application carries out auxiliary colouring to original painting using neural network, so that coloring work heavy during alleviating original painting colouring, conveniently and efficiently can be made and be modified to original painting.
Description
Technical field
The present invention relates to computer learning field more particularly to a kind of original painting neural network based auxiliary painting methods and
Device.
Background technique
The either process of electronic game exploitation or cartoon making requires a large amount of original painting work.Such as electricity
Sub- development of games, software developer require according to project planning design games role, scene of game, game item original painting or
In game dominant role it is vertical draw, the head portrait of various expressions etc..Because the design of these original paintings will be developed as electronic game below
Important references, so the drafting of above-mentioned original painting often has higher requirement to image quality and fineness, to facilitate other fine arts people
Member can be based on original painting, according to actual electronic game develop needs, supplement be plotted under different conditions environment game role,
The details of scene of game or game item.
However, because the drafting work of current original painting is largely dependent upon the experience of fine arts personnel, and this is often
It is needed to devote a tremendous amount of time to draw, so this makes software developer or outsourcing Chevron Research Company (CRC) spend biggish manpower
Cost and time complete above-mentioned task.Simultaneously as at electronic game or cartoon making initial stage, each side needs to specifically setting
Meter carries out repeated negotiation and modification, so that this has further dragged slowly the development progress of Related product, and improves development cost.
Summary of the invention
The purpose of the application is to solve the deficiencies in the prior art, provides a kind of original painting auxiliary neural network based colouring side
Method and device can obtain the technical effect painted to the original painting line original text of input from dynamic auxiliary.
To achieve the goals above, the following technical solution is employed by the application:
Firstly, the application proposes a kind of original painting auxiliary painting methods neural network based.Method includes the following steps:
S100 the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back) are obtained, and marks each subdivision area of original painting
The colouring parameter in domain forms original painting data sample；
S200) using Keras initialization colouring neural network model, wherein colouring neural network model uses VGG model；
S300 it) imports original painting data sample and is used as training set, neural network model exercises supervision study to painting；
S400) the colouring neural network model finished using training carries out automatic colouring to the original painting line original text of input.
Further, in the above method of the application, the step S100 further includes following sub-step:
S101 the original painting line original text and original painting colouring original text of each original painting colouring front and back) are matched, and on original painting line original text and original painting
Color original text is registrated；
S102) original painting divide based on original painting line original text and form prime area；
S103) based on hue threshold, saturation degree threshold value and luminance threshold, to prime area carry out region segmentation, formed
Divided area；
S104 tone, saturation degree and the average value of brightness in same divided area) are calculated, and by tone average value, saturation
Average value, average brightness and adjacent area number are spent as colouring parameter.
Still further, in the above method of the application, the colouring parameter at least further include on original painting line original text with
The adjacent original painting lines in divided area.
Further, in the above method of the application, original painting data sample is classified as according to the Color Style of original painting
Multiple sub- training sets, and corresponding multiple colouring neural network models are formed based on the sub- training set.
Further, in the above method of the application, the step S200 further includes following sub-step:
S201) using Keras establish and initialize VGG model convolutional layer and MAXpooling layers；
S202 evaluate to VGG model is configured) with real-time testing model training performance.
Still further, the step S300 further includes following sub-step in the above method of the application:
S301 the training set being made of original painting data sample) is imported into convolutional layer；
S302 it) is exercised supervision study using SqueezeNet convolutional neural networks to training set；
S303 the weight parameter of classifier in convolutional layer and MAXpooling layers) is assessed based on evaluate, and when detection
Deconditioning when weight parameter into classifier restrains.
Further, in the above method of the application, the step S400 includes following sub-step:
S401 the colouring neural network model that training finishes) is arranged in network server, and configures colouring neural network
The Data entries of model；
S402 original painting) is uploaded into colouring neural network model by Data entries to execute automatic colouring.
Still further, the Data entries are the forms of webpage in the above method of the application.
Secondly, disclosed herein as well is a kind of original paintings neural network based to assist coloring means.Described device can wrap
It includes with lower module: obtaining module, for obtaining the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back, and mark original painting
The colouring parameter of each divided area forms original painting data sample；Initialization module, for using Keras initialization colouring mind
Through network model, wherein colouring neural network model uses VGG model；Training module, for importing original painting data sample conduct
Training set exercises supervision study to colouring neural network model；Colouring module, the colouring neural network for being finished using training
Model carries out automatic colouring to the original painting line original text of input.
Further, in the above-mentioned apparatus of the application, the acquisition module may include following submodule: matching mould
Block, for matching the original painting line original text and original painting colouring original text of each original painting colouring front and back, and to original painting line original text and original painting paint original text into
Row registration；First division module forms prime area for divide to original painting based on original painting line original text；Second division module,
For based on hue threshold, saturation degree threshold value and luminance threshold, to prime area carry out region segmentation, formed divided area；
Mark module, for calculating tone in same divided area, saturation degree and the average value of brightness, and by tone average value, saturation
Average value, average brightness and adjacent area number are spent as colouring parameter.
Still further, in the above-mentioned apparatus of the application, the colouring parameter at least further include on original painting line original text with
The adjacent original painting lines in divided area.
Further, in the above-mentioned apparatus of the application, original painting data sample is classified as according to the Color Style of original painting
Multiple sub- training sets, and corresponding multiple colouring neural network models are formed based on the sub- training set.
Further, in the above-mentioned apparatus of the application, the initialization module can also include following submodule: establish
Module, for established and initialized using Keras VGG model convolutional layer and MAXpooling layers；Configuration module, for configuring
Evaluate to VGG model is with real-time testing model training performance.
Still further, the training module can also include following submodule in the above-mentioned apparatus of the application: importing
Module, for the training set being made of original painting data sample to be imported into convolutional layer；Execution module, for using SqueezeNet
Convolutional neural networks exercise supervision study to training set；Evaluation module, for based on evaluate assessment convolutional layer and
The weight parameter of classifier in MAXpooling layers, and the deconditioning when detecting the weight parameter convergence in classifier.
Further, in the above-mentioned apparatus of the application, the colouring module can also include following submodule: arrangement mould
Block for the colouring neural network model finished will to be trained to be arranged in network server, and configures colouring neural network model
Data entries；Uploading module, for original painting to be uploaded to colouring neural network model by Data entries to execute automatic colouring.
Still further, the Data entries are the forms of webpage in the above-mentioned apparatus of the application.
Finally, the application also proposes a kind of computer readable storage medium, it is stored thereon with computer instruction.Above-metioned instruction
When being executed by processor, following steps are executed:
S100 the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back) are obtained, and marks each subdivision area of original painting
The colouring parameter in domain forms original painting data sample；
S200) using Keras initialization colouring neural network model, wherein colouring neural network model uses VGG model；
S300 it) imports original painting data sample and is used as training set, neural network model exercises supervision study to painting；
S400) the colouring neural network model finished using training carries out automatic colouring to the original painting line original text of input.
Further, when processor executes above-metioned instruction, the step S100 further includes following sub-step:
S101 the original painting line original text and original painting colouring original text of each original painting colouring front and back) are matched, and on original painting line original text and original painting
Color original text is registrated；
S102) original painting divide based on original painting line original text and form prime area；
S103) based on hue threshold, saturation degree threshold value and luminance threshold, to prime area carry out region segmentation, formed
Divided area；
S104 tone, saturation degree and the average value of brightness in same divided area) are calculated, and by tone average value, saturation
Average value, average brightness and adjacent area number are spent as colouring parameter.
Still further, the colouring parameter at least further includes on original painting line original text when processor executes above-metioned instruction
The original painting lines adjacent with divided area.
Further, when processor executes above-metioned instruction, original painting data sample is classified according to the Color Style of original painting
For multiple sub- training sets, and corresponding multiple colouring neural network models are formed based on the sub- training set.
Further, when processor executes above-metioned instruction, the step S200 further includes following sub-step:
S201) using Keras establish and initialize VGG model convolutional layer and MAXpooling layers；
S202 evaluate to VGG model is configured) with real-time testing model training performance.
Still further, the step S300 further includes following sub-step when processor executes above-metioned instruction:
S301 the training set being made of original painting data sample) is imported into convolutional layer；
S302 it) is exercised supervision study using SqueezeNet convolutional neural networks to training set；
S303 the weight parameter of classifier in convolutional layer and MAXpooling layers) is assessed based on evaluate, and when detection
Deconditioning when weight parameter into classifier restrains.
Further, when processor executes above-metioned instruction, the step S400 includes following sub-step:
S401 the colouring neural network model that training finishes) is arranged in network server, and configures colouring neural network
The Data entries of model；
S402 original painting) is uploaded into colouring neural network model by Data entries to execute automatic colouring.
Still further, the Data entries are the forms of webpage when processor executes above-metioned instruction.
Having the beneficial effect that for the application carries out auxiliary colouring to original painting using neural network, to alleviate original painting colouring
Heavy coloring work in the process conveniently and efficiently can be made and be modified to original painting.
Detailed description of the invention
Fig. 1 show the flow chart of original painting painting methods neural network based disclosed in the present application；
Fig. 2 is shown in one embodiment of the application, forms the flow chart of original painting data sample submethod；
Fig. 3 is shown in embodiment of the method shown in Fig. 2, the schematic diagram of original painting data sample；
Fig. 4 is shown in another embodiment of the application, the process of colouring neural network model initialization submethod
Figure；
Fig. 5 is shown in another embodiment of the application, is exercised supervision to colouring neural network model and is learnt son side
The flow chart of method；
Fig. 6 is shown in another embodiment of the application, colouring neural network model to the original painting line original text of input into
The flow chart of row automatic colouring submethod；
Fig. 7 show the structure chart of original painting coloring means neural network based disclosed in the present application.
Specific embodiment
It is carried out below with reference to technical effect of the embodiment and attached drawing to the design of the application, specific structure and generation clear
Chu, complete description, to be completely understood by the purpose, scheme and effect of the application.It should be noted that the case where not conflicting
Under, the features in the embodiments and the embodiments of the present application can be combined with each other.
It should be noted that unless otherwise specified, when a certain feature referred to as " fixation ", " connection " are in another feature,
It can directly fix, be connected to another feature, and can also fix, be connected to another feature indirectly.In addition, this
The descriptions such as upper and lower, left and right used in application are only the mutual alignment pass relative to each component part of the application in attached drawing
For system.In the application and the "an" of singular used in the attached claims, " described " and "the" also purport
It is including most forms, unless the context clearly indicates other meaning.
In addition, unless otherwise defined, the technology of all technical and scientific terms used herein and the art
The normally understood meaning of personnel is identical.Term used in the description is intended merely to description specific embodiment herein, without
It is to limit the application.Term as used herein "and/or" includes the arbitrary of one or more relevant listed items
Combination.
It will be appreciated that though various elements may be described in this application using term first, second, third, etc., but
These elements should not necessarily be limited by these terms.These terms are only used to for same type of element being distinguished from each other out.For example, not taking off
In the case where the application range, first element can also be referred to as second element, and similarly, second element can also be referred to as
First element.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When ".
Method flow diagram shown in referring to Fig.1, in one or more embodiments of the application, original neural network based
Drawing auxiliary painting methods may comprise steps of:
S100 the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back) are obtained, and marks each subdivision area of original painting
The colouring parameter in domain forms original painting data sample；
S200) using Keras initialization colouring neural network model, wherein colouring neural network model uses VGG model；
S300 it) imports original painting data sample and is used as training set, neural network model exercises supervision study to painting；
S400) the colouring neural network model finished using training carries out automatic colouring to the original painting line original text of input.
Wherein, Keras can rapidly construct corresponding colouring nerve net as a kind of simple high-rise neural network tool
Network model is to be trained.Specifically, the tool that developer can be provided using Keras, the TensorFlow based on open source
System establishes colouring neural network model.Further, the test verifying through current mainstream from image it is found that extract CNN spy
Sign, being trained using VGG model is preference algorithm, is more suitable for that image color lump position is imitated and learnt.Ability
Field technique personnel can be based on related tool and the specific colouring neural network model of algorithm principle structure configuration.
Referring to method flow diagram shown in Fig. 2, in one or more embodiments of the application, the step S100 includes
Following sub-step:
S101 the original painting line original text and original painting colouring original text of each original painting colouring front and back) are matched, and on original painting line original text and original painting
Color original text is registrated；
S102) original painting divide based on original painting line original text and form prime area；
S103) based on hue threshold, saturation degree threshold value and luminance threshold, to prime area carry out region segmentation, formed
Divided area；
S104 tone, saturation degree and the average value of brightness in same divided area) are calculated, and by tone average value, saturation
Average value, average brightness and adjacent area number are spent as colouring parameter.
Specifically, referring to schematic diagram shown in Fig. 3, as the original painting data sample for training colouring neural network model
This, original painting line original text and original painting colouring original text will first be registrated, with accurately determined in subsequent sub-step each divided area with
The relative position that line original text Central Plains draws lines.Then, original painting line original text will divide prime area based on original painting lines.It draws prime area
The mode of dividing can use the existing image segmentation algorithm based on edge (for example, by using original painting lines as edge), and will segmentation
Prime area afterwards be added to original painting colouring original text, with determine prime area original painting colouring original text on corresponding region.It is then possible to base
In including but not limited to hue threshold, saturation degree threshold value and luminance threshold, region segmentation is carried out to prime area, forms subdivision
Region.Wherein, hue threshold, saturation degree threshold value and luminance threshold can be using least variance method or Two-dimensional Maximums in existing class
The image algorithms such as entropy partitioning algorithm determine.Those skilled in the art can be determined using appropriate algorithm above-mentioned as the case may be
Each threshold value for being used to divide divided area, the application not limit this.It is formed by divided area finally, for segmentation,
Calculate tone in corresponding divided area, saturation degree and the average value of brightness, and by the geometry in region and adjacent area
Information saves in the form of a file as colouring parameter.In addition, it will be understood by those skilled in the art that the display in attached drawing is first
The number and shape of part are only as illustrative reference, not as the limitation to the application.
Further, in the said one of the application or multiple embodiments, the colouring parameter at least further includes in original
The original painting lines adjacent with divided area on setting-out original text.Since the region of the adjacent two sides of original painting lines often has biggish color
Difference, therefore the classifier in neural network model of painting can improve the weight of corresponding parameter in initialization, to improve
The training effectiveness (colouring neural network model is enabled rapidly to restrain) and colouring nerve net of colouring neural network model
The accuracy rate of network model itself.
Still further, in the said one or multiple embodiments of the application, for the original painting of different-style, in order to mention
The applicability of height colouring neural network model, original painting data sample will be classified as multiple son training according to the Color Style of original painting
Collection, and corresponding multiple colouring neural network models are formed based on the sub- training set.At this point, the resulting colouring neural network of training
Model will correspond respectively to different original painting colouring styles.In use, original painting to be painted will be designated corresponding colouring style,
So as to more targetedly execute automatic colouring operation to the original painting of different specific requirements.
Referring to submethod flow chart shown in Fig. 4, in one or more embodiments of the application, the step S200 is also
Including following sub-step:
S201) using Keras establish and initialize VGG model convolutional layer and MAXpooling layers；
S202 evaluate to VGG model is configured) with real-time testing model training performance.
Specifically, the convolutional layer of VGG model is established and initialized using Keras and at MAXpooling layers, can use
The tool that Kersa itself is provided automatically saves the weight of each classifier conveniently to be iterated training.Meanwhile
Evaluate tool provided by Kersa also can be convenient ground real-time detection and assess trained colouring neural network model
Training effect, such as the colouring whether trained accuracy rate for finishing and painting of neural network model.
Further, submethod flow chart referring to Figure 5, it is described in one or more embodiments of the application
Step S300 further includes following sub-step:
S301 the training set being made of original painting data sample) is imported into convolutional layer；
S302 it) is exercised supervision study using SqueezeNet convolutional neural networks to training set；
S303 the weight parameter of classifier in convolutional layer and MAXpooling layers) is assessed based on evaluate, and when detection
Deconditioning when weight parameter into classifier restrains.
It is trained as mentioned previously, because evaluate tool provided by Kersa can be convenient ground real-time detection and assess
Colouring neural network model, check each repetitive exercise so can pass through in the training process of colouring neural network model
Whether the weight parameter variation of each classifier in front and back is greater than preset threshold value, to determine whether deconditioning.Art technology
Corresponding threshold value can be arranged in personnel according to specific training process, and the application not limits this.
Due in electronic game or cartoon making project, corresponding participant (such as software developer and outsourcing design
Fine arts personnel in company) geographical location can easily may modify original painting, reference relatively far apart in order to facilitate project personnel
Submethod flow chart shown in fig. 6, in one or more embodiments of the application, the step S400 includes following sub-step
It is rapid:
S401 the colouring neural network model that training finishes) is arranged in network server, and configures colouring neural network
The Data entries of model；
S402) original painting uploads to colouring neural network model by Data entries to execute automatic colouring.
Further, the Data entries can be the form of webpage.At this point it is possible to by with providing corresponding webpage
Modified original painting line original text is uploaded in corresponding network server by location by related personnel in webpage, and by network service
Device returns to the original painting colouring original text after colouring by network.
Referring to function structure chart shown in Fig. 7, in one or more embodiments of the application, original neural network based
Draw auxiliary coloring means may include with lower module: obtain module, for obtain multiple original paintings colouring front and back original painting line original text and
Original painting colouring original text, and the colouring parameter of each divided area of original painting is marked, form original painting data sample；Initialization module is used for
Colouring neural network model is initialized using Keras, wherein colouring neural network model uses VGG model；Training module is used for
It imports original painting data sample and is used as training set, neural network model exercises supervision study to painting；Colouring module, for utilizing instruction
Practice the colouring neural network model finished and automatic colouring is carried out to the original painting line original text of input.Wherein, Keras is as a kind of simple height
Layer neural network tool can construct corresponding colouring neural network model rapidly to be trained.Specifically, developer
The tool that can be provided using Keras, the TensorFlow system based on open source establish colouring neural network model.Further
Ground, the test verifying through current mainstream from image it is found that extract CNN feature, being trained using VGG model is preferred calculation
Method is more suitable for that image color lump position is imitated and learnt.Those skilled in the art can be based on related tool and calculation
The specific colouring neural network model of method theory structure configuration.
In one or more embodiments of the application, the acquisition module may include following submodule: matching module,
For matching the original painting line original text and original painting colouring original text of each original painting colouring front and back, and original painting line original text and original painting colouring original text are matched
It is quasi-；First division module forms prime area for divide to original painting based on original painting line original text；Second division module, is used for
Based on hue threshold, saturation degree threshold value and luminance threshold, to prime area carry out region segmentation, formed divided area；Mark
Module is put down for calculating tone in same divided area, saturation degree and the average value of brightness, and by tone average value, saturation degree
Mean value, average brightness and adjacent area number are as colouring parameter.Specifically, referring to schematic diagram shown in Fig. 3, as being used for
The original painting data sample of training colouring neural network model, original painting line original text and original painting colouring original text will be first registrated, subsequent
The relative position that each divided area and line original text Central Plains draw lines is accurately determined in sub-step.Then, original painting line original text will be based on
Original painting lines divide prime area.The division mode of prime area can be using the existing edge that is based on (for example, by using original painting line
Item is as edge) image segmentation algorithm, and by the prime area after segmentation be added to original painting colouring original text, to determine prime area
The corresponding region on original painting colouring original text.It is then possible to based on including but not limited to hue threshold, saturation degree threshold value and luminance threshold
Value carries out region segmentation to prime area, forms divided area.Wherein, hue threshold, saturation degree threshold value and luminance threshold can be with
It is determined using the image algorithms such as least variance method or Two-dimensional maximum-entropy partitioning algorithm in existing class.Those skilled in the art can be with
Determine that above-mentioned each threshold value for being used to divide divided area, the application not limit this using appropriate algorithm as the case may be
It is fixed.It is formed by divided area finally, for segmentation, calculates being averaged for tone in corresponding divided area, saturation degree and brightness
Value, and using the geometry in region and the information of adjacent area as colouring parameter, it saves in the form of a file.In addition, ability
Field technique personnel will be appreciated that the number and shape of the display element in attached drawing are only as illustrative reference, not as to this
The limitation of application.
Further, in the said one of the application or multiple embodiments, the colouring parameter at least further includes in original
The original painting lines adjacent with divided area on setting-out original text.Since the region of the adjacent two sides of original painting lines often has biggish color
Difference, therefore the classifier in neural network model of painting can improve the weight of corresponding parameter in initialization, to improve
The training effectiveness (colouring neural network model is enabled rapidly to restrain) and colouring nerve net of colouring neural network model
The accuracy rate of network model itself.
Still further, in the said one or multiple embodiments of the application, for the original painting of different-style, in order to mention
The applicability of height colouring neural network model, original painting data sample will be classified as multiple son training according to the Color Style of original painting
Collection, and corresponding multiple colouring neural network models are formed based on the sub- training set.At this point, the resulting colouring neural network of training
Model will correspond respectively to different original painting colouring styles.In use, original painting to be painted will be designated corresponding colouring style,
So as to more targetedly execute automatic colouring operation to the original painting of different specific requirements.
In one or more embodiments of the application, the initialization module can also include following submodule: establish
Module, for established and initialized using Keras VGG model convolutional layer and MAXpooling layers；Configuration module, for configuring
Evaluate to VGG model is with real-time testing model training performance.Specifically, it is established using Keras and initializes VGG model
Convolutional layer and at MAXpooling layers, can use Kersa itself offer tool automatically save the weight of each classifier with
Conveniently it is iterated training.Meanwhile evaluate tool provided by Kersa also can be convenient ground real-time detection simultaneously
Assess the training effect of trained colouring neural network model, for example, colouring neural network model it is whether trained finish with
And the accuracy rate of colouring.
Further, in one or more embodiments of the application, the training module can also include following submodule
Block: import modul, for the training set being made of original painting data sample to be imported into convolutional layer；Execution module, for using
SqueezeNet convolutional neural networks exercise supervision study to training set；Evaluation module, for assessing convolution based on evaluate
Layer and MAXpooling layer in classifier weight parameter, and when detect in classifier weight parameter convergence when stop instruct
Practice.As mentioned previously, because evaluate tool provided by Kersa can be convenient ground real-time detection and assess trained colouring
Neural network model, so can be by each before and after each repetitive exercise of inspection in the training process of colouring neural network model
Whether the weight parameter variation of a classifier is greater than preset threshold value, to determine whether deconditioning.Those skilled in the art can
Corresponding threshold value is arranged according to specific training process, the application not limits this.
Due in electronic game or cartoon making project, corresponding participant (such as software developer and outsourcing design
Fine arts personnel in company) geographical location can easily may modify original painting relatively far apart in order to facilitate project personnel, at this
In one or more embodiments of application, the colouring module can also include following submodule: arrangement module, for that will train
The colouring neural network model finished is arranged in network server, and configures the Data entries of colouring neural network model；It uploads
Module, for by original painting by Data entries upload to colouring neural network model to execute automatic colouring further, it is described
Data entries can be the form of webpage.At this point it is possible to by providing corresponding web page address, it will be modified by related personnel
Original painting line original text is uploaded in corresponding network server in webpage, and is led to the original painting colouring original text after colouring by network server
Cross network return.
It should be appreciated that embodiments herein can be by computer hardware, the combination of hardware and software or by depositing
The computer instruction in non-transitory computer-readable memory is stored up to be effected or carried out.Standard program can be used in this method
Technology-include realized in computer program configured with the non-transitory computer-readable storage media of computer program, wherein
Configured in this way storage medium operates computer in a manner of specific and is predefined --- according to retouching in a particular embodiment
The method and attached drawing stated.Each program can with the programming language of level process or object-oriented come realize with computer system
Communication.However, if desired, the program can be realized with compilation or machine language.Under any circumstance, which can be compiling
Or the language explained.In addition, the program can be run on the specific integrated circuit of programming for this purpose.
Further, this method can be realized in being operably coupled to suitable any kind of computing platform, wrap
Include but be not limited to PC, mini-computer, main frame, work station, network or distributed computing environment, individual or integrated
Computer platform or communicated with charged particle tool or other imaging devices etc..The various aspects of the application can be to deposit
The machine readable code on non-transitory storage medium or equipment is stored up to realize no matter be moveable or be integrated to calculating
Platform, such as hard disk, optical reading and/or write-in storage medium, RAM, ROM, so that it can be read by programmable calculator, when
Storage medium or equipment can be used for configuration and operation computer to execute process described herein when being read by computer.This
Outside, machine readable code, or part thereof can be transmitted by wired or wireless network.When such media include combining microprocessor
Or when other data processors realization instruction or program of the step above, application as described herein includes that these and other are different
The non-transitory computer-readable storage media of type.When being programmed according to methods and techniques described herein, the application is also
Including computer itself.
Computer program can be applied to input data to execute function as described herein, to convert input data with life
At storing to the output data of nonvolatile memory.Output information can also be applied to one or more output equipments as shown
Device.In the application preferred embodiment, the data of conversion indicate physics and tangible object, including the object generated on display
Reason and the particular visual of physical objects are described.
Therefore, should be with descriptive sense rather than restrictive sense understands the specification and drawings.However, by apparent
It is:, can be to the application in the case where not departing from the broader spirit and scope of the application as described in claims
Make various modifications and change.
Other modifications are in spirit herein.Therefore, although disclosed technology may be allowed various modifications and substitution structure
It makes, but has shown that in the accompanying drawings and its some embodiments shown in being described in detail above.It will be appreciated, however, that not
It is intended to for the application to be confined to disclosed one or more concrete forms；On the contrary, its intention covers such as the appended claims
Defined in fall in all modifications, alternative constructions and equivalent in spirit and scope.
Claims (10)
1. a kind of original painting neural network based assists painting methods, which comprises the following steps:
S100 the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back) are obtained, and marks each divided area of original painting
Colouring parameter, forms original painting data sample；
S200) using Keras initialization colouring neural network model, wherein colouring neural network model uses VGG model；
S300 it) imports original painting data sample and is used as training set, neural network model exercises supervision study to painting；
S400) the colouring neural network model finished using training carries out automatic colouring to the original painting line original text of input.
2. the method according to claim 1, wherein the step S100 further includes following sub-step:
S101 the original painting line original text and original painting colouring original text of each original painting colouring front and back) are matched, and to original painting line original text and original painting colouring original text
It is registrated；
S102) original painting divide based on original painting line original text and form prime area；
S103) based on hue threshold, saturation degree threshold value and luminance threshold, to prime area carry out region segmentation, formed subdivision
Region；
S104 tone, saturation degree and the average value of brightness in same divided area) are calculated, and tone average value, saturation degree are put down
Mean value, average brightness and adjacent area number are as colouring parameter.
3. method according to claim 1 or 2, which is characterized in that the colouring parameter at least further includes in original painting line original text
The upper original painting lines adjacent with divided area.
4. according to the method described in claim 3, it is characterized in that, original painting data sample is classified as according to the Color Style of original painting
Multiple sub- training sets, and corresponding multiple colouring neural network models are formed based on the sub- training set.
5. the method according to claim 1, wherein the step S200 further includes following sub-step:
S201) using Keras establish and initialize VGG model convolutional layer and MAXpooling layers；
S202 evaluate to VGG model is configured) with real-time testing model training performance.
6. according to the method described in claim 5, it is characterized in that, the step S300 further includes following sub-step:
S301 the training set being made of original painting data sample) is imported into convolutional layer；
S302 it) is exercised supervision study using SqueezeNet convolutional neural networks to training set；
S303 the weight parameter of classifier in convolutional layer and MAXpooling layer) is assessed based on evaluate, and ought be detected point
Deconditioning when weight parameter in class device restrains.
7. the method according to claim 1, wherein the step S400 further includes following sub-step:
S401 the colouring neural network model that training finishes) is arranged in network server, and configures colouring neural network model
Data entries；
S402) original painting uploads to colouring neural network model by Data entries to execute automatic colouring.
8. the method according to the description of claim 7 is characterized in that the Data entries are the forms of webpage.
9. a kind of original painting neural network based assists coloring means, which is characterized in that comprise the following modules:
Module is obtained, for obtaining the original painting line original text and original painting colouring original text of multiple original paintings colouring front and back, and marks original painting each thin
Subregional colouring parameter forms original painting data sample；
Initialization module, for initializing colouring neural network model using Keras, wherein colouring neural network model uses
VGG model；
Training module exercises supervision study to colouring neural network model for importing original painting data sample as training set；
Colouring module, the colouring neural network model for being finished using training carry out automatic colouring to the original painting line original text of input.
10. a kind of computer readable storage medium, is stored thereon with computer instruction, it is characterised in that the instruction is held by processor
It realizes when row such as the step of method described in any item of the claim 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811561946.XA CN109801346B (en) | 2018-12-20 | 2018-12-20 | Original painting auxiliary coloring method and device based on neural network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811561946.XA CN109801346B (en) | 2018-12-20 | 2018-12-20 | Original painting auxiliary coloring method and device based on neural network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109801346A true CN109801346A (en) | 2019-05-24 |
| CN109801346B CN109801346B (en) | 2023-06-30 |
Family
ID=66557234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811561946.XA Active CN109801346B (en) | 2018-12-20 | 2018-12-20 | Original painting auxiliary coloring method and device based on neural network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109801346B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110223359A (en) * | 2019-05-27 | 2019-09-10 | 浙江大学 | It is a kind of that color model and its construction method and application on the dual-stage polygamy colo(u)r streak original text of network are fought based on generation |
| CN110264478A (en) * | 2019-06-21 | 2019-09-20 | 腾讯科技（深圳）有限公司 | A kind of method and device of line manuscript base picture colouring |
| CN115937356A (en) * | 2022-04-25 | 2023-04-07 | 北京字跳网络技术有限公司 | Image processing method, apparatus, device and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170309061A1 (en) * | 2015-12-30 | 2017-10-26 | Wuhan United Imaging Healthcare Co., Ltd. | Systems and methods for data rendering |
| CN107330956A (en) * | 2017-07-03 | 2017-11-07 | 广东工业大学 | A kind of unsupervised painting methods of caricature manual draw and device |
| CN108510456A (en) * | 2018-03-27 | 2018-09-07 | 华南理工大学 | The sketch of depth convolutional neural networks based on perception loss simplifies method |
| CN108615252A (en) * | 2018-05-03 | 2018-10-02 | 苏州大学 | The training method and device of color model on line original text based on reference picture |
| CN108711138A (en) * | 2018-06-06 | 2018-10-26 | 北京印刷学院 | A kind of gray scale picture colorization method based on generation confrontation network |
| CN108830912A (en) * | 2018-05-04 | 2018-11-16 | 北京航空航天大学 | A kind of interactive grayscale image color method of depth characteristic confrontation type study |
-
2018
- 2018-12-20 CN CN201811561946.XA patent/CN109801346B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170309061A1 (en) * | 2015-12-30 | 2017-10-26 | Wuhan United Imaging Healthcare Co., Ltd. | Systems and methods for data rendering |
| CN107330956A (en) * | 2017-07-03 | 2017-11-07 | 广东工业大学 | A kind of unsupervised painting methods of caricature manual draw and device |
| CN108510456A (en) * | 2018-03-27 | 2018-09-07 | 华南理工大学 | The sketch of depth convolutional neural networks based on perception loss simplifies method |
| CN108615252A (en) * | 2018-05-03 | 2018-10-02 | 苏州大学 | The training method and device of color model on line original text based on reference picture |
| CN108830912A (en) * | 2018-05-04 | 2018-11-16 | 北京航空航天大学 | A kind of interactive grayscale image color method of depth characteristic confrontation type study |
| CN108711138A (en) * | 2018-06-06 | 2018-10-26 | 北京印刷学院 | A kind of gray scale picture colorization method based on generation confrontation network |
Non-Patent Citations (1)
| Title |
|---|
| 李炬: "基于生成对抗网络的人脸灰度图上色", 《电脑知识与技术》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110223359A (en) * | 2019-05-27 | 2019-09-10 | 浙江大学 | It is a kind of that color model and its construction method and application on the dual-stage polygamy colo(u)r streak original text of network are fought based on generation |
| CN110223359B (en) * | 2019-05-27 | 2020-11-17 | 浙江大学 | Dual-stage multi-color-matching-line draft coloring model based on generation countermeasure network and construction method and application thereof |
| CN110264478A (en) * | 2019-06-21 | 2019-09-20 | 腾讯科技（深圳）有限公司 | A kind of method and device of line manuscript base picture colouring |
| CN115937356A (en) * | 2022-04-25 | 2023-04-07 | 北京字跳网络技术有限公司 | Image processing method, apparatus, device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109801346B (en) | 2023-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109325437A (en) | Image processing method, device and system | |
| CN105912500B (en) | Machine learning model generation method and device | |
| CN109801346A (en) | A kind of original painting neural network based auxiliary painting methods and device | |
| Odden | Equity and adequacy in school finance today | |
| US20150339757A1 (en) | Method, system and computer program product for generating recommendations for products and treatments | |
| CN107766861A (en) | The recognition methods of character image clothing color, device and electronic equipment | |
| CN108038474A (en) | Method for detecting human face, the training method of convolutional neural networks parameter, device and medium | |
| CN107644415A (en) | A kind of text image method for evaluating quality and equipment | |
| CN104573359A (en) | Method for integrating crowdsource annotation data based on task difficulty and annotator ability | |
| CN106097222A (en) | The communal facility spatial accessibility taking user characteristics into account analyzes method and device | |
| CN108875794A (en) | Image visibility detection method based on transfer learning | |
| CN112164142A (en) | Building lighting simulation method based on smart phone | |
| CN109584153A (en) | Modify the methods, devices and systems of eye | |
| CN104751407A (en) | Method and device used for blurring image | |
| CN109191460A (en) | A kind of quality evaluating method for tone mapping image | |
| CN106355195A (en) | The system and method used to measure image resolution value | |
| CN104751406A (en) | Method and device used for blurring image | |
| CN110222940A (en) | A kind of crowdsourcing test platform tester's proposed algorithm | |
| CN109410138A (en) | Modify jowled methods, devices and systems | |
| CN105844974A (en) | Cloud physics laboratory learning platform | |
| CN109285160A (en) | One kind is scratched as method and system | |
| Zhang et al. | Linking Image-based Metrics to 3D Model-based Metrics for Assessment of Visual Landscape Quality | |
| Inanici | Dynamic daylighting simulations from static high dynamic range imagery using extrapolation and daylight coefficient methodologies | |
| CN109816744A (en) | One kind two-dimentional special efficacy Picture Generation Method neural network based and device | |
| CN109801345A (en) | A kind of original painting line original text neural network based auxiliary method for drafting and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |