WO2019200702A1 - 去网纹系统训练方法、去网纹方法、装置、设备及介质 - Google Patents
去网纹系统训练方法、去网纹方法、装置、设备及介质 Download PDFInfo
- Publication number
- WO2019200702A1 WO2019200702A1 PCT/CN2018/092569 CN2018092569W WO2019200702A1 WO 2019200702 A1 WO2019200702 A1 WO 2019200702A1 CN 2018092569 W CN2018092569 W CN 2018092569W WO 2019200702 A1 WO2019200702 A1 WO 2019200702A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- error function
- network
- texture
- pixel value
- training sample
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/088—Non-supervised learning, e.g. competitive learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/047—Probabilistic or stochastic networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0475—Generative networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/094—Adversarial learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/772—Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10008—Still image; Photographic image from scanner, fax or copier
Definitions
- the present application relates to the field of image processing, and in particular, to a method for training a netting system, a method for removing a netting, an apparatus, a device, and a medium.
- the embodiment of the present application provides a method, a device, a device and a medium for training a de-grid system, so as to solve the problem that the de-meshing effect of the current de-meshing model is poor.
- a method for training a netting system comprising:
- Extracting a sample to be trained includes a meshed training sample having an equal number of samples and a meshless training sample;
- a de-grid system training device comprising:
- a training sample obtaining module configured to extract a sample to be trained, wherein the sample to be trained includes a meshed training sample with an equal number of samples and a meshless training sample;
- a first error function acquiring module configured to input the meshed training sample into the texture extractor, extract a texture position, obtain a first error function based on the texture position and a preset label value, and The first error function updates a network parameter of the texture extractor;
- a second error function acquiring module configured to input the texture position and the meshed training sample into a generated confrontation network generator, generate a simulation picture, and based on the simulated picture and the untextured Training the sample to obtain a second error function;
- a discriminating result obtaining module configured to input the simulated picture and the untextured training sample into a generating type anti-network discriminator, obtain a discriminating result, and obtain a third error function and a fourth error according to the discriminating result function;
- a fifth error function acquiring module configured to extract a feature A of the simulated picture and a feature B of the untrained training sample by using a pre-trained face recognition model, and obtain the feature B according to the feature A and the feature B Fifth error function;
- the embodiment of the present application further provides a method, device, device and medium for removing the netting, so as to solve the problem that the current descreening effect is poor.
- a method of removing the netting comprising:
- the texture extractor Inputting the texture image to be input into the texture extractor, extracting the texture position of the to-be-removed picture; the texture extractor is obtained by using the de-grid system training method;
- the generated anti-network generator adopts the Obtained by the netting system training method.
- a descreening device comprising:
- a moiré position extraction module configured to input the to-be-removed picture into the texture extractor, extract the position of the texture of the to-be-removed picture, and the texture extractor uses the de-grid system to train Method obtained;
- a target de-texture picture generating module configured to input the mesh position of the to-be-removed picture and the to-be-removed picture into a generation-oriented network generator, to generate a target de-texture picture, and generate the target
- the anti-mesh generator is obtained by the de-grid system training method.
- a computer device comprising a memory, a processor, and computer readable instructions stored in the memory and operative on the processor, the processor executing the computer readable instructions to:
- Extracting a sample to be trained includes a meshed training sample having an equal number of samples and a meshless training sample;
- a computer device comprising a memory, a processor, and computer readable instructions stored in the memory and operative on the processor, the processor executing the computer readable instructions to:
- the texture extractor uses the above-described de-grid system training method to update the texture according to the first error function Obtained by the network parameters of the extractor;
- the generation-oriented network generator adopts the above-mentioned de-networking
- the pattern system training method acquires the network parameters of the generator against the network generator according to the sixth error function.
- a computer readable storage medium storing computer readable instructions that, when executed by a processor, implement the following steps:
- Extracting a sample to be trained includes a meshed training sample having an equal number of samples and a meshless training sample;
- a computer readable storage medium storing computer readable instructions, the processor implementing the computer readable instructions to implement the following steps:
- the texture extractor uses the above-described de-grid system training method to update the texture according to the first error function Obtained by the network parameters of the extractor;
- the generation-oriented network generator adopts the above-mentioned de-networking
- the pattern system training method acquires the network parameters of the generator against the network generator according to the sixth error function.
- the first error function (e_loss) is obtained based on the position of the mesh and the preset tag value, based on the simulated picture and the sample without the mesh training.
- the characteristics including the generated anti-network generator and the generated anti-network discriminator) are obtained according to the second error function, the third error function, the fourth error function and the fifth error function, and the error function of the generated generation against the network generator is sixth.
- the error function (g_loss) and the seventh error function (d_loss) of the error function of the generation against the network discriminator, the corresponding error function is constructed by the error generated in the training de-grid system, and the network is updated according to the error function.
- the network parameters of each part of the model in the system enable full and effective training of the de-grid system.
- the de-grid system covers the factors affecting the netting effect of the netting system during the training process of the de-grid system, so that the de-meshing system has a very good de-meshing effect when the image is descreened.
- the mesh position of the tomographic image is extracted by inputting the to-be-removed picture into the texture extractor, and the network to be removed
- the texture position of the picture and the picture to be removed are input into the generation-resisting network generator to generate a target-to-mesh picture, and the de-meshing effect using the de-grid method is very good.
- FIG. 1 is an application environment diagram of a mesh system training method according to an embodiment of the present application
- FIG. 2 is a flow chart of a method for training a mesh system in an embodiment of the present application
- FIG. 3 is a specific flow chart of step S20 of Figure 2;
- FIG. 4 is a specific flow chart of step S50 of Figure 2;
- FIG. 5 is a flowchart of a method for removing a mesh in an embodiment of the present application.
- FIG. 6 is a schematic diagram of a mesh system training device according to an embodiment of the present application.
- FIG. 7 is a schematic diagram of a de-meshing device in an embodiment of the present application.
- FIG. 8 is a schematic diagram of a computer device in an embodiment of the present application.
- the de-meshing system in the de-grid system training method includes a texture extractor, a face recognition model, a generated confrontation network generator, and a generated confrontation network discriminator, and the process of training the netting system is training to remove the texture. Network parameters for each component of the system.
- FIG. 1 shows an application environment of a de-grid system training method provided by an embodiment of the present application.
- the application environment of the de-netting system training method includes a server and a client, wherein the server and the client are connected through a network, and the client is a device capable of human-computer interaction with the user, including but not limited to a computer.
- the server can be implemented by a server cluster consisting of a separate server or multiple servers.
- the descreening system training method provided by the embodiment of the present application is applied to a server.
- FIG. 2 is a flowchart of a method for training a de-griding system according to an embodiment of the present application.
- the voice distinguishing method includes the following steps:
- Extracting a sample to be trained, the sample to be trained includes a meshed training sample with an equal number of samples and a meshless training sample.
- the meshed training sample refers to a picture with a netting for training the netting system
- the untextured training sample refers to a picture without a netting for training the netting system.
- the meshed training samples and the untextured training samples in the samples to be trained are identical except for the netting. For example, take the user's webbed photo and the user's untextured photo as a set of netted training samples and an equal number of untextured training samples for the training to the netting system.
- the equal number means that the proportional relationship between the netted training sample and the untextured training sample is 1:1.
- the sample to be trained is extracted, and the sample to be trained includes a meshed training sample with equal sample numbers and a meshless training sample, and the meshed training sample and the equal number of untextured training samples may be
- the sample size of the meshed training sample and the equal number of untextured training samples should be large enough, and the sample size is too small to fully train the netting system, resulting in poor descreening effect of the de-mesh system obtained by training.
- the sample size may specifically be 40,000 sets of textured training samples and no textured training samples.
- the difference between the meshed training sample and the non-reticulated training sample is only the presence or absence of a netting, so that sufficient training can be performed according to the difference to extract the meshed training samples and the number of equals.
- the distinguishing feature between the meshless training samples lays the foundation for effective training of the de-grid system.
- the texture extractor here is a pre-trained texture extraction model capable of extracting the position of the picture texture.
- the position of the netting is the relative position of the netting with the textured training sample in the textured training sample (such as a textured photo).
- the tag value refers to the actual situation of the meshed position in the meshed training sample and the corresponding meshless training sample (that is, the tag value is obtained by manual labeling according to the actual situation).
- the label value is used to calculate the error of the texture position extracted by the texture extractor and the actual position of the texture, and construct a corresponding error function to update the network parameters in the texture extractor according to the error function (the texture extractor is It is trained by the neural network model, so the texture extractor includes network parameters in the neural network).
- the first error function ie e_loss
- the first error function refers to an error function constructed from the error between the texture position extracted by the texture extractor and the preset label value.
- the meshed training sample is input to the network extractor, and the network extractor extracts the textured position of the meshed training sample, and extracts the extracted textured position and the preset label value.
- a suitable error function e_loss is constructed to measure the error between the extracted texture position and the preset label value. It can be understood that there is an error in the position of the mesh extracted from the meshed training sample by using the pre-trained mesh extractor (the actual position of the textured position, that is, the label value), due to the presence of the mesh.
- Training samples need to be trained in other model parts of the descreening system (such as the generated confrontation network generator and the generated anti-network discriminator), so the networked extractor should be trained here to train the network extractor.
- the network extractor is optimized so that the network extractor can more accurately extract the texture position of the meshed training sample, and improve the accuracy of the subsequent de-grid system training.
- step S20 the meshed training sample is input into the texture extractor, the position of the texture is extracted, and e_loss is obtained based on the position of the texture and the preset label value, and Updating the network parameters of the texture extractor according to e_loss includes the following steps:
- each pixel value of the texture position is obtained according to the texture extractor, and each pixel value is normalized into the interval of [0, 1] to obtain a normalized pixel value (ie, returning The pixel value after processing).
- a normalized pixel value ie, returning The pixel value after processing.
- the pixel value of an image has a pixel value level of 2 8 , 2 12 , and 2 16 , and a pair of images may contain a large number of different pixel values, which makes calculation inconvenient, so the method of normalizing pixel values is adopted.
- Each pixel value at the position of the texture is compressed in the same range, which simplifies the calculation and speeds up the training process of the de-grid system.
- the normalized pixel values of the meshless training samples are first calculated and acquired (the pixel values without the mesh training samples may also be normalized in advance, and normalized without calculation),
- the normalized pixel value of the texture position obtained in step S21 and the normalized normalized non-netted training sample are subtracted and taken as absolute values (which can be expressed as
- the pixel difference between the textured and the untextured is very obvious, so the use of the pixel difference can well represent the position of the texture.
- the preset demarcation value refers to a reference value set in advance for differentiating the pixel into values of 0 and 1.
- the binarized texture position is the position of the texture obtained by comparing the normalized pixel value with the preset boundary value and changing the normalized pixel value of the texture position.
- the preset boundary value may be set to 0.3. At this time, if the pixel difference is greater than 0.3, the normalized pixel value corresponding to the texture position is taken as 1; if the pixel value is not greater than 0.3, the network is The normalized pixel value corresponding to the land position is taken as 0.
- the binarized mesh position obtained by the preset boundary value can express the position of the mesh in a simple manner according to the characteristics of the texture on the picture, and can accelerate the training of the de-grid system.
- S24 calculating, according to each pixel value of the binarized mesh position and each pixel value corresponding to the preset tag value, acquiring a first error function, and updating a network parameter of the mesh extractor according to the first error function;
- the calculation formula of the first error function is Where n is the number of pixel values, x i represents the i-th pixel value of the binarized texture position, and y i represents the ith pixel value of the preset tag value corresponding to x i .
- each pixel value corresponding to the preset label value is represented by two types of values: the pixel value corresponding to the texture position is 1 (ie, "true” in the actual case), and is not the pixel value of the texture position. Is 0 (that is, "false” in the actual situation).
- the calculation is performed according to each pixel value of the binarized mesh position and each pixel value corresponding to the preset tag value, and the calculation process is a process of acquiring e_loss.
- e_loss is calculated as Where n is the number of pixel values, x i represents the i-th pixel value of the binarized texture position, and y i represents the ith pixel value of the preset tag value corresponding to x i .
- the e_loss refers to an error function constructed according to an error between a mesh position extracted by the texture extractor and a preset label value, and the error function can effectively reflect the position of the texture extracted by the texture extractor and the actual situation.
- the error function constructed by the error can be used to reverse the error of the network parameters in the texture extractor, and the network parameters in the texture extractor are updated.
- the method of updating the network parameters by the error function back propagation adopts the gradient descent method, and the gradient descent method here is not limited to the batch gradient descent method, the small batch gradient descent method and the stochastic gradient descent method.
- Gradient descent method can be used to find the minimum value of the error function, and the error function is minimized, so that the network parameters in the netting extractor can be updated effectively, so that the netting extractor after extracting the network parameters can extract the mesh position better. .
- updating the texture extractor according to the pixel value to extract the position of the texture is applicable to different types of texture (type of texture position), that is, in training the texture extractor.
- type of texture position a variety of different mesh types can be trained together; and in the texture extraction stage, any type of texture position can be directly extracted by the texture extractor, and there is no limitation of the texture type when extracting the texture position. .
- Generative Adversarial Networks is a deep learning model and one of the methods of unsupervised learning in complex distribution.
- the model learns to produce outputs that are fairly close to people's expectations through the mutual game of (at least) two modules in the framework: the Generative Model and the Discriminative Model.
- the generative confrontation network is actually updating the model of optimizing itself (including the generation model and the discriminant model) according to the game between the generation model and the discriminant model, and the generation model is responsible for generating an output highly similar to the training sample.
- the discriminant model is responsible for discriminating the authenticity of the output generated by the generated model and the height of the training sample.
- the "simulation" capability of the generated model will be stronger, and the output will be closer to the training sample.
- the discriminative ability of the discriminant model is also stronger, and the output of the height "simulation” generated by the generating module can be identified.
- the probability of the final discriminant model discriminating is about 50%, it means that the discriminant model can not distinguish the authenticity at this time ( About ⁇ guess, the simulation sample generated by the generation module is almost the same as the real training sample.
- the simulated image is generated by the generated image against the network generator, which can be known by the characteristics of the generated against the network generator.
- the generative confrontation network generator refers to a generation model of the generative confrontation network.
- the texture position and the textured training sample extracted by the texture extractor are input into a generation-oriented network generator (also a model), and the generation-resistance network generator is based on the texture position and the network.
- the pattern training samples generate corresponding simulation pictures.
- the generated confrontation network generator processes the input texture position and the textured training sample by using network parameters (weights and offsets) in the generator, and calculates a simulated picture. Since the simulated picture is generated, it is only the maximum to simulate and approximate the "pattern" of the meshless training sample.
- the second error function ie, l_loss
- the untrained training sample ie, the actual situation, here is the label action.
- L_loss refers to the error function constructed based on the error between the simulated image generated by the generator against the network generator and the actual situation (without the mesh training sample). Specifically, the error function l_loss constructed according to the error between the simulated picture and the actual situation can be used to inversely transmit the error of the network parameter in the generation against the network generator, and update the network parameter of the generation against the network generator.
- step S30 the mesh position and the meshed training sample are input into the generated confrontation network generator to generate a simulation picture, and the l_loss is obtained based on the simulated picture and the untrained training sample.
- l_loss is calculated as Where n is the number of pixel values, x i represents the ith pixel value of the simulated picture, and y i represents the ith pixel value corresponding to x i without the textured training sample.
- the pixel values respectively represented by x i and y i are subjected to an operation of the error function after the normalization process, which can effectively simplify the calculation and speed up the training process of the de-grid system.
- the simulated picture and the untextured training sample are input into a generation-response network discriminator to obtain a discrimination result.
- the generated anti-network discriminator is a network model corresponding to the generated anti-network generator, and is used for discriminating the authenticity of the generated simulated image against the network generator. That is, the generated confrontation network discriminator refers to a discriminant model of the generated confrontation network.
- gan_g_loss a third error function (ie, gan_g_loss) and a fourth error function (ie, gan_d_loss) according to the discriminating result of the generated anti-network discriminator
- gan_g_loss is an error function reflecting the generated anti-network generator generating the simulation picture, according to the error function
- the error is back-transferred to the network parameters in the generated anti-network generator, and the network parameters are updated
- gan_d_loss is an error function reflecting the generated anti-network discriminator discriminating simulation picture, which can be based on the error function in the generation against the network discriminator
- the network parameters are error-backed, and the generation parameters are updated against the network parameters in the network discriminator.
- step S40 the simulated picture and the non-mesh training sample are input into the generation-oriented network discriminator, and the determination result is obtained, and gan_g_loss and gan_d_loss are obtained according to the determination result, which specifically includes: a generation confrontation
- the discriminant results of the network discriminator output are D(G(X)) and D(Y)
- X represents the input of the generator against the network generator
- X consists of n x i
- x i represents the generator against the network generator input.
- the ith pixel value, G(X) represents the output of the generator against the network generator
- D(G(X)) represents the output of the generator against the network generator (ie, the simulated picture, as a generator against the network discriminator Input) the output of the generated anti-network discriminator (after discriminating)
- Y represents the input of the non-mesh training sample in the generator against the network discriminator
- Y consists of n y i
- y i represents no netting
- the training samples are input to the i-th pixel value of the generated anti-network discriminator
- D(Y) represents the output of the non-mesh training sample in the generation against the network discriminator.
- gan_g_loss is an error function describing the error that occurs when the generator against the network discriminator discriminates the output of the generator against the network generator.
- the calculation formula of gan_d_loss is Among them, gan_d_loss is an error function describing the error of the generated against the network discriminator when discriminating the sample without the netting training.
- the pixel values in step S40 are all subjected to an operation of the error function after the normalization process, which can effectively simplify the calculation and speed up the training process of the de-grid system.
- the face recognition model is pre-trained, and the face recognition model can be acquired by using an open source face set.
- the pre-trained face recognition model is used to extract the feature A of the simulated picture and the feature B without the mesh training sample (actual case), and obtain the corresponding fifth error according to the feature A and the feature B.
- Function (ie i_loss) It can be understood that the feature A of the simulated picture and the feature B without the mesh training sample are extracted by the face recognition model, and the error function i_loss constructed according to the feature A and the feature B can reflect the simulated picture and the untrained training sample. The degree of similarity on the subtle features, the subtle features extracted by the face recognition model can reflect the difference between the simulated picture and the unlined training sample. According to the difference, the appropriate error function i_loss can be constructed and generated according to the i_loss update.
- the network parameters in the anti-network generator and the network parameters in the generation against the network discriminator make the simulation image generated by the generator against the network generator more "true", and the more powerful the discriminative ability of the generation against the network discriminator (Because the simulated picture is used as an input in the generator against the network discriminator, an error is also generated, so i_loss can also update the network parameters in the generation against the network discriminator).
- step S50 the feature A of the simulated picture and the feature B without the mesh training sample are extracted by using the pre-trained face recognition model, and acquired according to the feature A and the feature B.
- I_loss including the following steps:
- the feature of the face recognition model extracting the simulated picture is that the feature image is extracted from the pre-trained face recognition model by inputting the simulation picture into the face recognition model, and the feature is taken as a feature.
- the feature A may specifically refer to extracting each pixel value in the simulated picture by the pre-trained face recognition model.
- S52 Input the untrained training sample into the pre-trained face recognition model to extract feature B.
- the face recognition model extracts the feature without the mesh training sample by extracting the untrained training sample into the face recognition model, and extracting the mesh without the netted face recognition model from the pre-trained face recognition model
- the feature that is included in the training sample is taken as the feature B.
- the feature B may specifically refer to extracting each pixel value corresponding to the feature A in the simulated picture by the pre-trained face recognition model.
- S53 Calculate the Euclidean distance of the feature A and the feature B, and obtain a fifth error function, and the calculation formula of the fifth error function is Where n is the number of pixel values, a i represents the ith pixel value in feature A, and b i represents the ith pixel value in feature B.
- the Euclidean distance is used as the error function of the feature A and the feature B, and the error function can well describe the difference between the feature A and the feature B.
- the error function i_loss constructed according to the difference can be back-reversed and updated.
- the network parameters and generation in the network generator counter the network parameters in the network discriminator, so that the generated simulated picture achieves almost the same effect as the untextured training sample.
- the pixel values respectively represented by a i and b i are subjected to an operation of the error function after the normalization process, which can effectively simplify the calculation and speed up the training process of the de-grid system.
- the sixth error function (ie, g_loss) is the error function finally adopted by the update generation against the network parameters in the network generator.
- l_loss reflects the error between the generated simulation image generated by the network generator and the actual situation (without the mesh training sample);
- gan_g_loss reflects the generation of the simulation image generated by the generated network generator.
- the error in discriminating against the network discriminator this error is reflected in the simulation picture as the input of the generation network discriminator, which is different from l_loss);
- i_loss reflects between the simulated picture and the unlined training sample.
- Feature difference ie error
- the method of updating the network parameters by the error function back propagation adopts the gradient descent method, and the gradient descent method here is not limited to the batch gradient descent method, the small batch gradient descent method and the stochastic gradient descent method.
- the seventh error function (ie, d_loss) is an error function finally adopted by the update generation against the network parameter in the network discriminator.
- gan_d_loss reflects the error that occurs when the generated against the network discriminator discriminates against the unlined training samples.
- I_loss reflects the error in the feature extracted from the face recognition model between the simulated picture and the unlined training sample. The error can be obtained by using the simulated picture and the non-mesh training sample as the generation-oriented network discriminator. It is reflected when input.
- the error functions in the sense of these two different dimensions can reflect the error of the discriminant result when the generator against the network discriminator is discriminated. Therefore, both error functions can be used to update the generated anti-network discriminator.
- the method of updating the network parameters by the error function back propagation adopts the gradient descent method, and the gradient descent method here is not limited to the batch gradient descent method, the small batch gradient descent method and the stochastic gradient descent method.
- e_loss is obtained based on the position of the mesh and the preset tag value, and the network parameter of the nettext extractor is updated in reverse according to e_loss, so that the nettext extractor updated according to e_loss is obtained.
- the mesh position of extracting the meshed training sample and the data without the mesh training sample is more accurate, and the accuracy of the subsequent de-grid system training is improved.
- the network discriminator obtains the error function g_loss of the generator against the network generator and the error function d_loss of the generator against the network discriminator according to l_loss, gan_g_loss, gan_g_loss and i_loss, by the error generated by each part of the model in the training de-grid system,
- the corresponding error function is constructed by different error functions in multiple dimensions, and the error functions in multiple dimensions are added, and the error function is finally adopted according to the generator-against network generator and the generated-against network discriminator.
- the network parameters of each part of the network system are updated to achieve full and effective training of the de-grid system.
- the de-grid system covers the factors affecting the netting effect of the netting system during the training process of the netting system. Each factor reflects the possible errors in the respective dimensions, and constructs an appropriate error function according to the error and reverses
- the network parameters are updated and the entire de-grid system is trained, so that the de-grid system can achieve very excellent effects when the image is descreened.
- Fig. 5 is a block diagram showing the principle of the de-grid system training apparatus corresponding to the de-mesh system training method in the embodiment.
- the de-grid system training device includes a training sample acquisition module 10, a first error function acquisition module 20, a second error function acquisition module 30, a discrimination result acquisition module 40, and a fifth error function acquisition module 50.
- the implementation function of the acquisition module 70 corresponds to the steps corresponding to the de-mesh system training method in the embodiment. To avoid redundancy, the embodiment is not described in detail.
- the training sample obtaining module 10 is configured to extract the samples to be trained, and the samples to be trained include the meshed training samples with the same number of samples and the untrained training samples.
- the first error function obtaining module 20 is configured to input the meshed training sample into the texture extractor, extract the texture position, obtain the first error function based on the texture position and the preset label value, and obtain the first error according to the first error.
- the function updates the network parameters of the texture extractor.
- the second error function obtaining module 30 is configured to input the mesh position and the meshed training sample into the generated confrontation network generator, generate a simulation picture, and acquire a second error function based on the simulated picture and the untextured training sample. .
- the discriminating result obtaining module 40 is configured to input the simulated picture and the untextured training sample into the generated anti-network discriminator, obtain the discriminating result, and obtain the third error function and the fourth error function according to the discriminating result.
- the fifth error function obtaining module 50 is configured to extract the feature A of the simulated picture and the feature B without the mesh training sample by using the pre-trained face recognition model, and acquire the fifth error function according to the feature A and the feature B.
- the first error function acquisition module 20 includes a normalization unit 21, a pixel difference acquisition unit 22, a texture position binarization unit 23, and a first error function acquisition unit 24.
- the normalization unit 21 is configured to obtain each pixel value of the texture position, and normalize each pixel value to obtain a normalized pixel value; wherein the formula for obtaining the normalized pixel value is MaxValue represents the maximum of all pixel values of the texture position, MinValue represents the minimum of all pixel values of the texture position, x is the value of each pixel, and y is the normalized pixel value.
- the pixel difference acquisition unit 22 is configured to obtain a pixel difference of the normalized pixel value of the texture position and the corresponding normalized pixel value of the meshless training sample.
- the texture position binarization unit 23 is configured to: if the pixel difference is greater than the preset boundary value, the normalized pixel value corresponding to the texture position is taken as 1, and if the pixel difference is not greater than the preset boundary value, the texture is The normalized pixel value corresponding to the position is taken as 0, and the binarized texture position is obtained.
- the first error function acquiring unit 24 is configured to perform calculation according to each pixel value of the binarized mesh position and each pixel value corresponding to the preset tag value, obtain a first error function, and update according to the first error function.
- a network parameter of the texture extractor wherein the calculation formula of the first error function is Where n is the number of pixel values, x i represents the i-th pixel value of the binarized texture position, and y i represents the ith pixel value of the preset tag value corresponding to x i .
- the calculation formula of the second error function is Where n is the number of pixel values, x i represents the ith pixel value of the simulated picture, and y i represents the ith pixel value corresponding to x i without the textured training sample.
- the discrimination result is D(G(X)) and D(Y)
- X represents the input of the generator against the network generator
- X is composed of n x i
- x i represents the generation of the generator against the network generator input.
- G(X) represents the output of the generator against the network generator
- D(G(X)) represents the output of the generator against the network generator
- Y means no network
- the pattern of the training pattern is generated by the generator against the network discriminator, Y consists of n y i , and y i represents the i-th pixel value of the non-mesh training sample input to the generated anti-network discriminator, D(Y) represents No mesh training samples are generated in the output against the network discriminator;
- the fifth error function acquisition module 50 includes a feature A extraction unit 51, a feature B extraction unit 52, and a fifth error function acquisition unit 53.
- a feature A extracting unit 51 configured to input a simulated picture into a pre-trained face recognition model, and extract feature A;
- a feature B extracting unit 52 configured to input a meshless training sample into a pre-trained face recognition model, and extract feature B;
- the fifth error function acquiring unit 53 is configured to calculate the Euclidean distance of the feature A and the feature B, and obtain a fifth error function, and the calculation formula of the fifth error function is Where n is the number of pixel values, a i represents the ith pixel value in feature A, and b i represents the ith pixel value in feature B.
- Figure 6 shows a flow chart of a method of descreening in an embodiment.
- the de-grain method can be applied to financial institutions such as banks, securities, investment and insurance, or other computer equipment that needs to perform image de-texting, in order to perform re-texturing on pictures with netting to achieve artificial intelligence.
- the computer device is a device capable of human-computer interaction with a user, including but not limited to a computer, a smart phone, and a tablet.
- the de-meshing method includes the following steps:
- the picture to be removed refers to the target picture to be subjected to the texture processing.
- the screen to be removed is input into the texture extractor, and the texture position of the texture image to be removed is extracted by the texture extractor, and the target texture image is generated according to the texture position.
- the netting extractor formed by updating the network parameter of the netting extractor by using the first error function obtained by the de-grid system training method in the embodiment can accurately extract the mesh position of the to-be-removed image, and effectively improve the netting extraction. The accuracy.
- the target to the netted picture refers to the target picture obtained after the texture pattern is to be removed.
- the texture position extracted by the texture extractor in the screen to be removed is input into the generated confrontation network generator together with the to-be-removed picture, and the generated network is based on the texture.
- the position removes the texture to be removed from the textured image, and generates a target to the textured image.
- the generation of the anti-network generator formed by the sixth error function obtained by the de-mesh system training method in the embodiment is used to accurately remove the texture in the screen to be removed, which can effectively Improve the texture effect.
- the texture position of the to-be-removed picture is first extracted by the texture extractor, and the first error function obtained by the de-grid system training method in the embodiment is used to update the texture extractor.
- the netting extractor formed by the network parameter can accurately extract the position of the mesh to be removed from the textured image, effectively improve the accuracy of the netting extraction, and then remove the mesh to be removed according to the position of the mesh by the generating type against the network generator.
- the netting in the picture, the target to the netted picture is generated, and the sixth error function obtained by the de-meshing system training method in the embodiment is used to update the generated type against the network parameter of the network generator, and the generated generation against the network generator is accurately removed.
- the texture of the netted image can be effectively improved to remove the netting effect.
- the target to be netted by the de-netting method has almost no difference with the corresponding image before the netting, which can achieve very good. Go to the net effect.
- Fig. 7 is a block diagram showing the principle of the de-meshing apparatus corresponding to the de-meshing method in the embodiment.
- the de-meshing device includes a textured position extraction module 80 and a target de-griple picture generation module 90.
- the implementation functions of the mesh position extraction module 80 and the target descreening image generation module 90 are in one-to-one correspondence with the steps corresponding to the de-meshing method in the embodiment. To avoid redundancy, the present embodiment will not be described in detail.
- the mesh position extraction module 80 is configured to input the to-be-removed picture into the texture extractor, and extract the position of the texture to be removed from the texture image, and the texture extractor is obtained by using the de-grid system training method in the embodiment.
- the first error function is obtained after updating the network parameters of the texture extractor.
- the target de-grid picture generation module 90 is configured to input the texture position of the to-be-removed picture and the to-be-removed picture into the generation-oriented network generator, generate a target de-grid picture, and generate a confrontation network generator. It is obtained by using the sixth error function obtained by the de-grid system training method in the embodiment to update the network parameters of the generated generator against the network generator.
- the embodiment provides a computer readable storage medium on which computer readable instructions are stored.
- the computer readable instructions are executed by the processor, the method for training the descreening system in the embodiment is implemented. I won't go into details here.
- the computer readable instructions are executed by the processor, the functions of the modules/units of the descreening system training device in the embodiment are implemented. To avoid repetition, details are not described herein again.
- the computer readable instructions are executed by the processor, the functions of the steps in the descreening method in the embodiment are implemented. To avoid repetition, details are not described herein.
- the computer readable instructions are executed by the processor, the functions of the modules/units in the descreening device in the embodiment are implemented. To avoid repetition, details are not described herein.
- FIG. 8 is a schematic diagram of a computer device according to an embodiment of the present application.
- the computer device 100 of this embodiment includes a processor 101, a memory 102, and computer readable instructions 103 stored in the memory 102 and executable on the processor 101, the computer readable instructions 103 being processed
- the computer readable instructions 103 are implemented by the processor 101 to implement the functions of the models/units in the de-grid system training device in the embodiment.
- the computer readable instructions 103 are implemented by the processor 101 to implement the functions of the steps in the descreening method in the embodiment.
- the computer readable instructions 103 when executed by the processor 101, implement the functions of the various modules/units in the descreening device of the embodiment. To avoid repetition, we will not go into details here.
- computer readable instructions 103 may be partitioned into one or more modules/units, one or more modules/units being stored in memory 102 and executed by processor 101 to complete the application.
- the one or more modules/units may be an instruction segment of a series of computer readable instructions 103 capable of performing a particular function, which is used to describe the execution of computer readable instructions 103 in computer device 100.
- the computer readable instructions 103 can be divided into the training sample acquisition module 10, the first error function acquisition module 20, the second error function acquisition module 30, the discrimination result acquisition module 40, and the fifth error function acquisition module 50 in the embodiment.
- the sixth error function acquisition module 60 and the seventh error function acquisition module 100, or the texture position extraction module 80 and the target de-grid picture generation module 90 in the embodiment, the specific functions of each module are as shown in the embodiment, Avoid duplication, not to repeat them here.
- the computer device 100 can be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server.
- Computer devices may include, but are not limited to, processor 101, memory 102. It will be understood by those skilled in the art that FIG. 8 is merely an example of the computer device 100 and does not constitute a limitation of the computer device 100, and may include more or less components than those illustrated, or may combine certain components or different components.
- the computer device may also include an input and output device, a network access device, a bus, and the like.
- the processor 101 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.
- the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
- the memory 102 can be an internal storage unit of the computer device 100, such as a hard disk or memory of the computer device 100.
- the memory 102 can also be an external storage device of the computer device 100, such as a plug-in hard disk equipped on the computer device 100, a smart memory card (SMC), a Secure Digital (SD) card, and a flash memory card (Flash). Card) and so on.
- the memory 102 may also include both an internal storage unit of the computer device 100 and an external storage device.
- Memory 102 is used to store computer readable instructions 103 and other programs and data required by the computer device.
- the memory 102 can also be used to temporarily store data that has been or will be output.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (20)
- 一种去网纹系统训练方法,其特征在于,包括:提取待训练样本,所述待训练样本包括样本数量相等的带网纹训练样本和不带网纹训练样本;将所述带网纹训练样本输入到网纹提取器中,提取网纹位置,基于所述网纹位置和预设的标签值获取第一误差函数,并根据所述第一误差函数更新网纹提取器的网络参数;将所述网纹位置和所述带网纹训练样本输入到生成式对抗网络生成器中,生成仿真图片,并基于所述仿真图片和所述不带网纹训练样本获取第二误差函数;将所述仿真图片和所述不带网纹训练样本输入到生成式对抗网络判别器中,获取判别结果,并根据所述判别结果获取第三误差函数和第四误差函数;采用预先训练好的人脸识别模型提取所述仿真图片的特征A和所述不带网纹训练样本的特征B,根据所述特征A和所述特征B获取第五误差函数;获取第六误差函数,根据所述第六误差函数更新生成式对抗网络生成器中的网络参数,其中,第六误差函数=第二误差函数+第三误差函数+第五误差函数;获取第七误差函数,根据所述第七误差函数更新生成式对抗网络判别器中的网络参数,其中,第七误差函数=第四误差函数+第五误差函数。
- 根据权利要求1所述的去网纹系统训练方法,其特征在于,所述基于所述网纹位置和预设的标签值获取第一误差函数,并根据所述第一误差函数更新网纹提取器的网络参数,包括:获取所述网纹位置的每一像素值,将每一所述像素值进行归一化处理,获取归一化像素值;其中,获取归一化像素值的公式为 MaxValue表示所述网纹位置的所有像素值中的最大值,MinValue表示所述网纹位置的所有像素值中的最小值,x为每一像素值,y为归一化像素值;获取所述网纹位置的归一化像素值和对应的不带网纹训练样本的归一化像素值的像素差;若所述像素差大于预设分界值,则将所述网纹位置对应的所述归一化像素值取作1,若所述像素差不大于所述预设分界值,则将所述网纹位置对应的所述归一化像素值取作0,获取二值化网纹位置;
- 根据权利要求1所述的去网纹系统训练方法,其特征在于,所述判别结果为D(G (X))和D(Y),X表示所述生成式对抗网络生成器的输入,X由n个x i组成,x i表示生成式对抗网络生成器输入的第i个像素值,G(X)表示所述生成式对抗网络生成器的输出,D(G(X))表示所述生成式对抗网络生成器的输出在所述生成式对抗网络判别器的输出,Y表示所述不带网纹训练样本在所述生成式对抗网络判别器的输入,Y由n个y i组成,y i表示所述不带网纹训练样本输入到所述生成式对抗网络判别器的第i个像素值,D(Y)表示所述不带网纹训练样本在所述生成式对抗网络判别器的输出;
- 一种去网纹方法,其特征在于,包括:将待去网纹图片输入到网纹提取器中,提取所述待去网纹图片的网纹位置;所述网纹提取器是采用权利要求1-5任一项所述去网纹系统训练方法根据第一误差函数更新网纹提取器的网络参数获取到的;将所述待去网纹图片的网纹位置和所述待去网纹图片输入到生成式对抗网络生成器中,生成目标去网纹图片;所述生成式对抗网络生成器是采用权利要求1-5任一项所述去网纹系统训练方法根据第六误差函数更新生成式对抗网络生成器的网络参数获取到的。
- 一种去网纹系统训练装置,其特征在于,包括:训练样本获取模块,用于提取待训练样本,所述待训练样本包括样本数量相等的带网纹训练样本和不带网纹训练样本;第一误差函数获取模块,用于将所述带网纹训练样本输入到网纹提取器中,提取网纹位置,基于所述网纹位置和预设的标签值获取第一误差函数,并根据所述第一误差函数更新网纹提取器的网络参数;第二误差函数获取模块,用于将所述网纹位置和所述带网纹训练样本输入到生成式对抗网络生成器中,生成仿真图片,并基于所述仿真图片和所述不带网纹训练样本获取第二误差函数;判别结果获取模块,用于将所述仿真图片和所述不带网纹训练样本输入到生成式对抗网络判别器中,获取判别结果,并根据所述判别结果获取第三误差函数和第四误差函数;第五误差函数获取模块,用于采用预先训练好的人脸识别模型提取所述仿真图片的特征A和所述不带网纹训练样本的特征B,根据所述特征A和所述特征B获取第五误差函数;第六误差函数获取模块,用于获取第六误差函数,根据所述第六误差函数更新生成式对抗网络生成器中的网络参数,其中,第六误差函数=第二误差函数+第三误差函数+第五误差函数;第七误差函数获取模块,用于获取第七误差函数,根据所述第七误差函数更新生成式对抗网络判别器中的网络参数,其中,第七误差函数=第四误差函数+第五误差函数。
- 一种去网纹装置,其特征在于,包括:网纹位置提取模块,用于将待去网纹图片输入到网纹提取器中,提取所述待去网纹图片的网纹位置,所述网纹提取器是采用权利要求1-5任一项所述去网纹系统训练方法根据第一误差函数更新网纹提取器的网络参数获取到的;目标去网纹图片生成模块,用于将所述待去网纹图片的网纹位置和所述待去网纹图片输入到生成式对抗网络生成器中,生成目标去网纹图片,所述生成式对抗网络生成器是采用权利要求1-5任一项所述去网纹系统训练方法根据第六误差函数更新生成式对抗网络生成器的网络参数获取到的。
- 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:提取待训练样本,所述待训练样本包括样本数量相等的带网纹训练样本和不带网纹训练样本;将所述带网纹训练样本输入到网纹提取器中,提取网纹位置,基于所述网纹位置和预设的标签值获取第一误差函数,并根据所述第一误差函数更新网纹提取器的网络参数;将所述网纹位置和所述带网纹训练样本输入到生成式对抗网络生成器中,生成仿真图片,并基于所述仿真图片和所述不带网纹训练样本获取第二误差函数;将所述仿真图片和所述不带网纹训练样本输入到生成式对抗网络判别器中,获取判别结果,并根据所述判别结果获取第三误差函数和第四误差函数;采用预先训练好的人脸识别模型提取所述仿真图片的特征A和所述不带网纹训练样本的特征B,根据所述特征A和所述特征B获取第五误差函数;获取第六误差函数,根据所述第六误差函数更新生成式对抗网络生成器中的网络参数,其中,第六误差函数=第二误差函数+第三误差函数+第五误差函数;获取第七误差函数,根据所述第七误差函数更新生成式对抗网络判别器中的网络参数,其中,第七误差函数=第四误差函数+第五误差函数。
- 根据权利要求9所述的计算机设备,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:获取所述网纹位置的每一像素值,将每一所述像素值进行归一化处理,获取归一化像素值;其中,获取归一化像素值的公式为 MaxValue表示所述网纹位置的所有像素值中的最大值,MinValue表示所述网纹位置的所有像素值中的最小值,x为每一像素值,y为归一化像素值;获取所述网纹位置的归一化像素值和对应的不带网纹训练样本的归一化像素值的像素差;若所述像素差大于预设分界值,则将所述网纹位置对应的所述归一化像素值取作1,若所述像素差不大于所述预设分界值,则将所述网纹位置对应的所述归一化像素值取作0,获取二值化网纹位置;
- 根据权利要求9所述的计算机设备,其特征在于,所述判别结果为D(G(X))和D(Y),X表示所述生成式对抗网络生成器的输入,X由n个x i组成,x i表示生成式对抗网络生成器输入的第i个像素值,G(X)表示所述生成式对抗网络生成器的输出,D(G(X))表示所述生成式对抗网络生成器的输出在所述生成式对抗网络判别器的输出,Y表示所述不带网纹训练样本在所述生成式对抗网络判别器的输入,Y由n个y i组成,y i表示所述不带网纹训练样本输入到所述生成式对抗网络判别器的第i个像素值,D(Y)表示所述不带网纹训练样本在所述生成式对抗网络判别器的输出;
- 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:将待去网纹图片输入到网纹提取器中,提取所述待去网纹图片的网纹位置;所述网纹提取器是采用权利要求1-5任一项所述去网纹系统训练方法根据第一误差函数更新网纹提取器的网络参数获取到的;将所述待去网纹图片的网纹位置和所述待去网纹图片输入到生成式对抗网络生成器中,生成目标去网纹图片;所述生成式对抗网络生成器是采用权利要求1-5任一项所述去 网纹系统训练方法根据第六误差函数更新生成式对抗网络生成器的网络参数获取到的。
- 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可读指令,其特征在于,所述计算机可读指令被处理器执行时实现如下步骤:提取待训练样本,所述待训练样本包括样本数量相等的带网纹训练样本和不带网纹训练样本;将所述带网纹训练样本输入到网纹提取器中,提取网纹位置,基于所述网纹位置和预设的标签值获取第一误差函数,并根据所述第一误差函数更新网纹提取器的网络参数;将所述网纹位置和所述带网纹训练样本输入到生成式对抗网络生成器中,生成仿真图片,并基于所述仿真图片和所述不带网纹训练样本获取第二误差函数;将所述仿真图片和所述不带网纹训练样本输入到生成式对抗网络判别器中,获取判别结果,并根据所述判别结果获取第三误差函数和第四误差函数;采用预先训练好的人脸识别模型提取所述仿真图片的特征A和所述不带网纹训练样本的特征B,根据所述特征A和所述特征B获取第五误差函数;获取第六误差函数,根据所述第六误差函数更新生成式对抗网络生成器中的网络参数,其中,第六误差函数=第二误差函数+第三误差函数+第五误差函数;获取第七误差函数,根据所述第七误差函数更新生成式对抗网络判别器中的网络参数,其中,第七误差函数=第四误差函数+第五误差函数。
- 根据权利要求15所述的计算机可读存储介质,其特征在于,所述计算机可读指令被处理器执行时实现如下步骤:获取所述网纹位置的每一像素值,将每一所述像素值进行归一化处理,获取归一化像素值;其中,获取归一化像素值的公式为 MaxValue表示所述网纹位置的所有像素值中的最大值,MinValue表示所述网纹位置的所有像素值中的最小值,x为每一像素值,y为归一化像素值;获取所述网纹位置的归一化像素值和对应的不带网纹训练样本的归一化像素值的像素差;若所述像素差大于预设分界值,则将所述网纹位置对应的所述归一化像素值取作1,若所述像素差不大于所述预设分界值,则将所述网纹位置对应的所述归一化像素值取作0,获取二值化网纹位置;
- 根据权利要求15所述的计算机可读存储介质,其特征在于,所述判别结果为D(G(X))和D(Y),X表示所述生成式对抗网络生成器的输入,X由n个x i组成,x i表示生 成式对抗网络生成器输入的第i个像素值,G(X)表示所述生成式对抗网络生成器的输出,D(G(X))表示所述生成式对抗网络生成器的输出在所述生成式对抗网络判别器的输出,Y表示所述不带网纹训练样本在所述生成式对抗网络判别器的输入,Y由n个y i组成,y i表示所述不带网纹训练样本输入到所述生成式对抗网络判别器的第i个像素值,D(Y)表示所述不带网纹训练样本在所述生成式对抗网络判别器的输出;
- 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可读指令,其特征在于,所述计算机可读指令被处理器执行时实现如下步骤:将待去网纹图片输入到网纹提取器中,提取所述待去网纹图片的网纹位置;所述网纹提取器是采用权利要求1-5任一项所述去网纹系统训练方法根据第一误差函数更新网纹提取器的网络参数获取到的;将所述待去网纹图片的网纹位置和所述待去网纹图片输入到生成式对抗网络生成器中,生成目标去网纹图片;所述生成式对抗网络生成器是采用权利要求1-5任一项所述去网纹系统训练方法根据第六误差函数更新生成式对抗网络生成器的网络参数获取到的。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/627,755 US20200125836A1 (en) | 2018-04-20 | 2018-06-25 | Training Method for Descreening System, Descreening Method, Device, Apparatus and Medium |
| SG11201913728SA SG11201913728SA (en) | 2018-04-20 | 2018-06-25 | Training method for descreening system, descreening method, device, apparatus and medium |
| JP2019563812A JP6812086B2 (ja) | 2018-04-20 | 2018-06-25 | 網状パターン除去システムのトレーニング方法、網状パターン除去方法、装置、機器及び媒体 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810360251.9 | 2018-04-20 | ||
| CN201810360251.9A CN108734673B (zh) | 2018-04-20 | 2018-04-20 | 去网纹系统训练方法、去网纹方法、装置、设备及介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019200702A1 true WO2019200702A1 (zh) | 2019-10-24 |
Family
ID=63939701
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2018/092569 Ceased WO2019200702A1 (zh) | 2018-04-20 | 2018-06-25 | 去网纹系统训练方法、去网纹方法、装置、设备及介质 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20200125836A1 (zh) |
| JP (1) | JP6812086B2 (zh) |
| CN (1) | CN108734673B (zh) |
| SG (1) | SG11201913728SA (zh) |
| WO (1) | WO2019200702A1 (zh) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111325317A (zh) * | 2020-01-21 | 2020-06-23 | 北京空间机电研究所 | 一种基于生成对抗网络的波前像差确定方法及装置 |
| CN112785495A (zh) * | 2021-01-27 | 2021-05-11 | 驭势科技(南京)有限公司 | 图像处理模型训练方法、图像生成方法、装置和设备 |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107103271A (zh) * | 2016-02-23 | 2017-08-29 | 芋头科技(杭州)有限公司 | 一种人脸检测方法 |
| KR102366777B1 (ko) * | 2019-04-01 | 2022-02-24 | 한국전자통신연구원 | 도메인 적응 기반 객체 인식 장치 및 그 방법 |
| CN110097130B (zh) * | 2019-05-07 | 2022-12-13 | 深圳市腾讯计算机系统有限公司 | 分类任务模型的训练方法、装置、设备及存储介质 |
| CN110175961B (zh) * | 2019-05-22 | 2021-07-27 | 艾特城信息科技有限公司 | 一种基于人脸图像分割对抗思想的去网纹方法 |
| CN110647805B (zh) * | 2019-08-09 | 2023-10-31 | 平安科技(深圳)有限公司 | 一种网纹图像识别方法、装置及终端设备 |
| CN110765843B (zh) * | 2019-09-03 | 2023-09-22 | 平安科技(深圳)有限公司 | 人脸验证方法、装置、计算机设备及存储介质 |
| CN112836701A (zh) * | 2019-11-25 | 2021-05-25 | 中国移动通信集团浙江有限公司 | 人脸识别方法、装置及计算设备 |
| CN111695605B (zh) * | 2020-05-20 | 2024-05-10 | 平安科技(深圳)有限公司 | 基于oct图像的图像识别方法、服务器及存储介质 |
| CN114882897B (zh) * | 2022-05-13 | 2025-06-20 | 平安科技(深圳)有限公司 | 语音转换模型的训练及语音转换方法、装置和相关设备 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5777367B2 (ja) * | 2011-03-29 | 2015-09-09 | キヤノン株式会社 | パターン識別装置、パターン識別方法及びプログラム |
| CN105760859A (zh) * | 2016-03-22 | 2016-07-13 | 中国科学院自动化研究所 | 基于多任务卷积神经网络的网纹人脸图像识别方法及装置 |
| CN105930797A (zh) * | 2016-04-21 | 2016-09-07 | 腾讯科技(深圳)有限公司 | 一种人脸验证方法及装置 |
| CN106548159A (zh) * | 2016-11-08 | 2017-03-29 | 中国科学院自动化研究所 | 基于全卷积神经网络的网纹人脸图像识别方法与装置 |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106203333A (zh) * | 2016-07-08 | 2016-12-07 | 乐视控股(北京)有限公司 | 人脸识别方法及系统 |
| CN107766844A (zh) * | 2017-11-13 | 2018-03-06 | 杭州有盾网络科技有限公司 | 一种网纹照人脸识别的方法、装置、设备 |
-
2018
- 2018-04-20 CN CN201810360251.9A patent/CN108734673B/zh active Active
- 2018-06-25 SG SG11201913728SA patent/SG11201913728SA/en unknown
- 2018-06-25 US US16/627,755 patent/US20200125836A1/en not_active Abandoned
- 2018-06-25 WO PCT/CN2018/092569 patent/WO2019200702A1/zh not_active Ceased
- 2018-06-25 JP JP2019563812A patent/JP6812086B2/ja active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5777367B2 (ja) * | 2011-03-29 | 2015-09-09 | キヤノン株式会社 | パターン識別装置、パターン識別方法及びプログラム |
| CN105760859A (zh) * | 2016-03-22 | 2016-07-13 | 中国科学院自动化研究所 | 基于多任务卷积神经网络的网纹人脸图像识别方法及装置 |
| CN105930797A (zh) * | 2016-04-21 | 2016-09-07 | 腾讯科技(深圳)有限公司 | 一种人脸验证方法及装置 |
| CN106548159A (zh) * | 2016-11-08 | 2017-03-29 | 中国科学院自动化研究所 | 基于全卷积神经网络的网纹人脸图像识别方法与装置 |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111325317A (zh) * | 2020-01-21 | 2020-06-23 | 北京空间机电研究所 | 一种基于生成对抗网络的波前像差确定方法及装置 |
| CN111325317B (zh) * | 2020-01-21 | 2023-12-12 | 北京空间机电研究所 | 一种基于生成对抗网络的波前像差确定方法及装置 |
| CN112785495A (zh) * | 2021-01-27 | 2021-05-11 | 驭势科技(南京)有限公司 | 图像处理模型训练方法、图像生成方法、装置和设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| SG11201913728SA (en) | 2020-01-30 |
| JP6812086B2 (ja) | 2021-01-13 |
| JP2020522780A (ja) | 2020-07-30 |
| CN108734673B (zh) | 2019-11-15 |
| US20200125836A1 (en) | 2020-04-23 |
| CN108734673A (zh) | 2018-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019200702A1 (zh) | 去网纹系统训练方法、去网纹方法、装置、设备及介质 | |
| WO2021077984A1 (zh) | 对象识别方法、装置、电子设备及可读存储介质 | |
| US8792722B2 (en) | Hand gesture detection | |
| CN111695392B (zh) | 基于级联的深层卷积神经网络的人脸识别方法及系统 | |
| US20120027263A1 (en) | Hand gesture detection | |
| WO2019109743A1 (zh) | Url攻击检测方法、装置以及电子设备 | |
| CN107944020A (zh) | 人脸图像查找方法及装置、计算机装置和存储介质 | |
| CN109359214A (zh) | 基于神经网络的视频描述生成方法、存储介质及终端设备 | |
| CN110765843B (zh) | 人脸验证方法、装置、计算机设备及存储介质 | |
| WO2017166586A1 (zh) | 基于卷积神经网络的图片鉴别方法、系统和电子设备 | |
| CN114677565B (zh) | 特征提取网络的训练方法和图像处理方法、装置 | |
| WO2021258699A1 (zh) | 一种图像识别方法、装置、电子设备和计算机可读介质 | |
| CN108875533A (zh) | 人脸识别的方法、装置、系统及计算机存储介质 | |
| WO2021051497A1 (zh) | 肺结核判定方法、装置、计算机设备及存储介质 | |
| CN114627534B (zh) | 活体判别方法及电子设备、存储介质 | |
| CN110047081A (zh) | 胸部x光图像的实例分割方法、装置、设备及介质 | |
| CN113869253A (zh) | 活体检测方法、训练方法、装置、电子设备及介质 | |
| CN111310724A (zh) | 基于深度学习的活体检测方法、装置、存储介质及设备 | |
| TWI803243B (zh) | 圖像擴增方法、電腦設備及儲存介質 | |
| CN112580668A (zh) | 一种背景欺诈检测方法、装置及电子设备 | |
| CN116266419B (zh) | 一种活体检测方法、装置和计算机设备 | |
| Jakhar et al. | Effective near-duplicate image detection using perceptual hashing and deep learning | |
| CN113762042B (zh) | 视频识别方法、装置、设备以及存储介质 | |
| CN109993178B (zh) | 一种特征数据生成和特征匹配方法及装置 | |
| CN113569707A (zh) | 活体检测方法、装置、电子设备以及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| ENP | Entry into the national phase |
Ref document number: 2019563812 Country of ref document: JP Kind code of ref document: A |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18915717 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.01.2021) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18915717 Country of ref document: EP Kind code of ref document: A1 |









