CN109829848A - A kind of system and method for Image space transformation neural network based in internet detection - Google Patents

A kind of system and method for Image space transformation neural network based in internet detection Download PDF

Info

Publication number
CN109829848A
CN109829848A CN201910043506.3A CN201910043506A CN109829848A CN 109829848 A CN109829848 A CN 109829848A CN 201910043506 A CN201910043506 A CN 201910043506A CN 109829848 A CN109829848 A CN 109829848A
Authority
CN
China
Prior art keywords
data
pixel
original image
image
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910043506.3A
Other languages
Chinese (zh)
Inventor
吴凡
郭骁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Liuzhou Kang Yun Internet Technology Co Ltd
Original Assignee
Liuzhou Kang Yun Internet Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liuzhou Kang Yun Internet Technology Co Ltd filed Critical Liuzhou Kang Yun Internet Technology Co Ltd
Priority to CN201910043506.3A priority Critical patent/CN109829848A/en
Publication of CN109829848A publication Critical patent/CN109829848A/en
Pending legal-status Critical Current

Links

Abstract

The present invention provides a kind of system and methods for Image space transformation neural network based in internet detection, including Model Management Service device end and data management server, the Model Management Service device end includes reading data and initialization module, for reading the image data in the data management server, which is base-line data, conventional application scenarios data, unconventional application scenarios data;Model construction module constructs spatial alternation network model according to the image data that the reading data and initialization module are read, to obtain transition matrix;It further include interpolation device, the data that the original image data and above-mentioned transformation matrix that the interpolation device is provided according to reading data and initialization module provide are calculated, and obtained output result is exported to master network, and testing result most is calculated through master network afterwards.

Description

A kind of system for Image space transformation neural network based in internet detection And method
Technical field
The present invention relates to internet detection field, a kind of correction picture shooting in internet detection field is more particularly related to System and method.
Background technique
With the fast development of artificial intelligence field machine learning techniques, internet detection field also achieves quick hair Exhibition refers to utilize neural network in " one kind is for measurement detection system and method neural network based in internet detection " The system and method for prediction model.
In most situations, neural network is one from the black-box model for being input to output.And detected from internet Angle says, there are many problem be can be specific, have the problem of certain stringent theoretical basis, for problems, can adopt The mode of particular model is taken to optimize, the present invention mainly attempts to solve the problems, such as shooting angle in internet detection.
Summary of the invention
In order to solve the problems in the existing technology, present invention thus provides one kind for being based in internet detection The system of the Image space transformation of neural network, including Model Management Service device end and data management server, the model management Server end includes reading data and initialization module, for reading the image data in the data management server, the figure Sheet data is base-line data, conventional application scenarios data, unconventional application scenarios data;
The image data construction space that the model construction module is read according to the reading data and initialization module becomes Switching network model, to obtain transition matrix;
The spatial alternation network model is configured to include the model with lower layer: initial data input layer → convolutional layer → pond Change layer → convolutional layer → pond layer → output layer, so that the output layer exports 6 parameters or 9 Parameter Switch matrixes;
The data that the initial data input layer provides the reading data and initialization module carry out data prediction, The convolutional layer carries out feature extraction, and the pond layer carries out Feature Compression, and the output layer is calculated according to the feature extracted Element in transformation matrix;
The 6 Parameter Switch matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of pixel i a certain in original image;After pixel conversion Transverse and longitudinal coordinate;θ is the element of matrix;
The 9 parameter transformation matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of a certain pixel i after conversion;x′i、y′i、z′iIt is converted for the pixel Coordinate in three dimensions afterwards;θ is the element of matrix;
By x 'i、y′i、z′iIt is mapped to two bit planes and obtains the corresponding transverse and longitudinal coordinate of i pixel in original image:
Further include interpolation device, original image data that the interpolation device is provided according to reading data and initialization module and The data that above-mentioned transformation matrix provides are calculated, and obtained output result is exported to master network, are most calculated afterwards through master network To testing result.
Further, the partial pixel that the interpolation device extracts original image is converted, and is done to the value of other pixels slotting Value processing.
Further, the base-line data refers to: in data acquisition, exterior light when fixed acquisition takes, mobile phone picture Machine exposure compensating, white balance state, characteristic value, the mobile phone posture of test paper glazing correction unit etc. carry out test paper picture shooting, right Collected data carry out feature extraction to calculate corresponding value as base-line data.
Further, the conventional application scenarios data refer to: same test paper, various without fixation in data acquisition Control condition factor, it is only necessary to which each factor meets the definition of conventional scenario application, can take pictures, and data obtained are passed through Final data obtained after collection apparatus algorithm
Further, the unconventional scene application data refer to: fixed various control condition factors when acquisition make it not Meet conventional scenario application conditions, control condition factor include shooting angle, illumination colour temperature, brightness, camera white balance mode, Camera exposure compensation model, data obtained pass through data obtained after collection apparatus algorithm.
Further, after obtaining 6 Parameter Switch matrixes, with bilinear interpolation to the image data of initial data input layer It carries out resampling and obtains the image data after spatial alternation;
Formula is as follows:
Wherein,After transformation, the value in the channel c of pixel i;W and H is the width and height of original image;N is original Certain a line of image;M is a certain column of original image;It is the channel c of the pixel of (m, n) for coordinate in original image Value;For the transverse and longitudinal coordinate of pixel i in original image.
A kind of method for Image space transformation neural network based in internet detection is also provided, including is walked as follows It is rapid:
Confirm that initialization model management server end, confirmation data management server end are opened;
The image data in data management server is read using reading data and initialization module, which is base Line number evidence, conventional application scenarios data or unconventional application scenarios data;
The image data construction space read using model construction module according to the reading data and initialization module is become Switching network model, to obtain transition matrix;
So that the spatial alternation network model is configured to include the model with lower layer: initial data input layer → convolutional layer → pond layer → convolutional layer → pond layer → output layer, so that the output layer exports 6 parameters or 9 Parameter Switch matrixes;
Wherein, it is pre- that the data that the initial data input layer provides the reading data and initialization module carry out data Processing, the convolutional layer carry out feature extraction, and the pond layer carries out Feature Compression, and the output layer is according to the feature extracted Calculate the element in transformation matrix;
The 6 Parameter Switch matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of pixel i a certain in original image;After pixel conversion Transverse and longitudinal coordinate;θ is the element of matrix;
The 9 parameter transformation matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of a certain pixel i after conversion;x′i、y′i、z′iIt is converted for the pixel Coordinate in three dimensions afterwards;θ is the element of matrix;
By x 'i、y′i、z′iIt is mapped to two bit planes and obtains the corresponding transverse and longitudinal coordinate of i pixel in original image:
Using interpolation device according to the original image data and above-mentioned transformation matrix of reading data and initialization module offer The data of offer are calculated, and obtained output result is exported to master network, and testing result most is calculated through master network afterwards.
Further, after obtaining 6 Parameter Switch matrixes, with bilinear interpolation to the image data of initial data input layer It carries out resampling and obtains the image data after spatial alternation;
Formula is as follows:
Wherein,After transformation, the value in the channel c of pixel i;W and H is the width and height of original image;N is original Certain a line of image;M is a certain column of original image;It is the channel c of the pixel of (m, n) for coordinate in original image Value;For the transverse and longitudinal coordinate of pixel i in original image.
The invention has the benefit that the present invention can solve the mark that the different picture of shooting angle is converted into equal angular Quasi- picture problem.
Detailed description of the invention
When considered in conjunction with the accompanying drawings, can be good at understanding that structure of the invention, principle, work are special with reference to following description Point and advantage, but attached drawing described herein as is used to that of the invention is explained further, and accompanying schematic figure is intended merely to preferably right The present invention is illustrated, and does not constitute improper restriction to the present invention, in which:
Fig. 1 is that the principle of the system for Image space transformation neural network based in internet detection of the invention is shown It is intended to.
Specific embodiment
Below with reference to example and attached drawing, the invention will be further described, it is noted that following embodiment is only Be it is schematical, be not intended to limitation the present invention.
System for Image space transformation neural network based in internet detection of the invention, including model management Server end and data management server, the Model Management Service device end include reading data and initialization module, model construction Module, model training module, model testing module.
Model Management Service device end: mainly including reading data and initialization module, model construction module, model training mould Block, model testing module.
Confirmation initialization model management server end, data management server end open the step of after,
The reading data and initialization module read image data collected, which can be baseline number According to, conventional application scenarios data, unconventional application scenarios data.
The base-line data refers to: in data acquisition, fixing exterior light photograph when acquisition, mobile phone camera exposure is mended Repay, characteristic value, mobile phone posture etc. of white balance state, test paper glazing correction unit carry out test paper picture shooting, every test paper is adopted Collect such as 5-10 data, acquire multiple test paper, feature extraction is carried out to collected data and is made with calculating corresponding value For base-line data, the average value of multi collect data can be taken as base-line data at this time.The feature can be picture RGB, HARR, HOG, SIFT, LBP are equivalent.The method of the feature extraction can use prior art progress.The base-line data Value be training data sample true value, that is, label value.That is every test paper finally corresponds to a label value.
The routine application scenarios data refer to: each data of middle shooting is obtained according to following methods for same Test paper, in data acquisition without fixed various control condition factors, it is only necessary to each factor meets the definition of conventional scenario application, It can take pictures, i.e., in such a case, it is possible to arbitrarily shoot picture, every test paper acquires repeatedly respectively, number obtained According to passing through collection apparatus algorithm and then being for example averaged algorithm finally data obtained, as conventional applied field The data shot in scape, final every test paper is corresponding to obtain a conventional application scenarios data.Multiple test paper are acquired, routine is obtained Application scenarios data set.
The unconventional scene application data refer to: fixed various control condition factors when acquisition make it be unsatisfactory for routine Scene application conditions, control condition factor include shooting angle, illumination colour temperature, brightness, camera white balance mode, camera exposure Compensation model etc..Data obtained pass through data obtained after collection apparatus algorithm, and every test paper acquires repeatedly respectively, Data obtained by collection apparatus algorithm and then be for example averaged algorithm finally data obtained as non- The data shot in conventional application scenarios.Multiple test paper are acquired, unconventional application scenarios data set is obtained.
The data configuration spatial alternation net that the model construction module is read according to the reading data and initialization module Network, to obtain transition matrix.
Specifically the model construction module executes following steps:
The spatial alternation network model is configured to include the model with lower layer by initialization model: initial data input Layer → convolutional layer → pond layer → convolutional layer → pond layer → output layer, so that the output layer exports 6 parameters or 9 Parameter Switch Matrix.
The data that the initial data input layer provides the reading data and initialization module carry out data prediction, Convolutional layer carries out feature extraction, and the pond layer carries out Feature Compression, and the output layer calculates transformation according to the feature extracted Element in matrix.
Wherein the transition matrix is 6 Parameter Switch matrixes, it may be assumed that
Affine transformation matrix may be expressed as:
Wherein,For the transverse and longitudinal coordinate of pixel i a certain in original image;After pixel conversion Transverse and longitudinal coordinate;θ is the element of matrix.
Construct 9 parameter perspective transformation matrixs, perspective transform and the difference of affine transformation be 3 × 2 transition matrixes become to 3 × 3 transition matrixes;
Perspective transformation matrix may be expressed as:
Wherein,For the transverse and longitudinal coordinate of a certain pixel i after conversion;x′i、y′i、z′iIt is converted for the pixel Coordinate in three dimensions afterwards;θ is the element of matrix.
By x 'i、y′i、z′iIt is mapped to two bit planes and obtains the corresponding transverse and longitudinal coordinate of i pixel in original image:
After obtaining transition matrix, using interpolation device according to the raw image data that reading data and initialization module provide with And the data that above-mentioned transformation matrix provides are calculated, obtained output result is exported to master network, is most calculated afterwards through master network Obtain testing result.
The partial pixel that the interpolation device extracts original image is converted, and is done interpolation processing to the value of other pixels, is subtracted Few calculation amount, improves computational efficiency.
The master network is neural network, can use another patent application " the neural network prediction mould of applicant Type ", it can also be carried out using neural network existing in the prior art.
It, can be with bilinear interpolation to initial data input layer after obtaining 6 Parameter Switch matrixes by taking affine transformation as an example Image data carry out resampling obtain the image data after spatial alternation.
Formula is as follows:
Wherein,After transformation, the value in the channel c of pixel i;W and H is the width and height of original image;N is original Certain a line of image;M is a certain column of original image;It is the channel c of the pixel of (m, n) for coordinate in original image Value;For the transverse and longitudinal coordinate of pixel i in original image.
Above formula pairIt can lead, withFor, derivation result is as follows:
According to " one kind is for measurement detection system and method neural network based in the internet detection " method mentioned, Spatial alternation network can be trained, and utilizes back-propagation algorithm and gradient descent method Optimal Parameters, ultimately generates spatial alternation Picture afterwards.
Need that important is heretofore described models can take the arbitrary number of plies and layer connection structure.
The invention patent the method is bound in any other model and uses, and can directly input.
It can also include model training module, be mainly used for being trained model, carry out basic verifying.And model Inspection module: it is mainly used for testing to the predictive ability of model.Above-mentioned training module, model testing module can be using existing There is the technology in technology to carry out, can also be carried out using the relevant patent application of applicant, for example, using the " a kind of of applicant For internet detection in it is neural network based measurement detection system and method " described in model.
Although having been combined embodiment to be described in detail the present invention, it should be understood by those skilled in the art that Ground is that the present invention is not limited only to specific embodiment, on the contrary, becoming in the various amendments without departing from the application spirit and essence Shape and replacement are all fallen among the protection scope of the application.

Claims (8)

1. a kind of system for Image space transformation neural network based in internet detection, which is characterized in that including mould Type management server end and data management server, the Model Management Service device end include reading data and initialization module, are used In reading the image data in the data management server, the image data be base-line data, conventional application scenarios data or Unconventional application scenarios data;
The model construction module constructs spatial alternation net according to the image data that the reading data and initialization module are read Network model, to obtain transition matrix;
The spatial alternation network model is configured to include the model with lower layer: initial data input layer → convolutional layer → pond layer → convolutional layer → pond layer → output layer, so that the output layer exports 6 parameters or 9 Parameter Switch matrixes;
The data that the initial data input layer provides the reading data and initialization module carry out data prediction, described Convolutional layer carries out feature extraction, and the pond layer carries out Feature Compression, and the output layer calculates transformation according to the feature extracted Element in matrix;
The 6 Parameter Switch matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of pixel i a certain in original image;For the transverse and longitudinal after pixel conversion Coordinate;θ is the element of matrix;
The 9 parameter transformation matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of a certain pixel i after conversion;x′i、y′i、z′iThree after being converted for the pixel Coordinate in dimension space;θ is the element of matrix;
By x 'i、y′i、z′iIt is mapped to two bit planes and obtains the corresponding transverse and longitudinal coordinate of i pixel in original image:
It further include interpolation device, original image data that the interpolation device is provided according to reading data and initialization module and above-mentioned The data that transformation matrix provides are calculated, and obtained output result is exported to master network, and inspection most is calculated through master network afterwards Survey result.
2. the system according to claim 1 for Image space transformation neural network based in internet detection, It is characterized in that, the partial pixel that the interpolation device extracts original image is converted, and does interpolation processing to the value of other pixels.
3. the system according to claim 1 for Image space transformation neural network based in internet detection, It is characterized in that, the base-line data refers to: in data acquisition, fixing exterior light photograph when acquisition, mobile phone camera exposure is mended Repay, characteristic value, mobile phone posture etc. of white balance state, test paper glazing correction unit carry out test paper picture shooting, to collected Data carry out feature extraction to calculate corresponding value as base-line data.
4. the system according to claim 1 for Image space transformation neural network based in internet detection, It is characterized in that, the routine application scenarios data refer to: same test paper, in data acquisition without fixed various control conditions Factor, it is only necessary to which each factor meets the definition of conventional scenario application, can take pictures, and data obtained pass through collection apparatus Final data obtained after algorithm.
5. the system according to claim 1 for Image space transformation neural network based in internet detection, Be characterized in that, the unconventional scene application data refer to: fixed various control condition factors when acquisition make it be unsatisfactory for routine Scene application conditions, control condition factor include shooting angle, illumination colour temperature, brightness, camera white balance mode, camera exposure Compensation model, data obtained pass through data obtained after collection apparatus algorithm.
6. the system according to claim 2 for Image space transformation neural network based in internet detection, It is characterized in that, after obtaining 6 Parameter Switch matrixes, is adopted again with image data of the bilinear interpolation to initial data input layer Sample obtains the image data after spatial alternation;
Formula is as follows:
Wherein,After transformation, the value in the channel c of pixel i;W and H is the width and height of original image;N is original image Certain a line;M is a certain column of original image;It is the value in the channel c of the pixel of (m, n) for coordinate in original image;For the transverse and longitudinal coordinate of pixel i in original image.
7. a kind of method for Image space transformation neural network based in internet detection, it is characterised in that including as follows Step:
Confirm that initialization model management server end, confirmation data management server end are opened;
The image data in data management server is read using reading data and initialization module, which is baseline number According to, conventional application scenarios data or unconventional application scenarios data;
Spatial alternation net is constructed according to the image data that the reading data and initialization module are read using model construction module Network model, to obtain transition matrix;
So that the spatial alternation network model is configured to include the model with lower layer: initial data input layer → convolutional layer → pond Change layer → convolutional layer → pond layer → output layer, so that the output layer exports 6 parameters or 9 Parameter Switch matrixes;
Wherein, the initial data input layer locates the data progress data that the reading data and initialization module provide in advance Reason, the convolutional layer carry out feature extraction, and the pond layer carries out Feature Compression, and the output layer is calculated according to the feature extracted Element in transformation matrix out;
The 6 Parameter Switch matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of pixel i a certain in original image;For the transverse and longitudinal after pixel conversion Coordinate;θ is the element of matrix;
The 9 parameter transformation matrix is expressed as:
Wherein,For the transverse and longitudinal coordinate of a certain pixel i after conversion;x′i、y′i、z′iFor the pixel conversion after Coordinate in three-dimensional space;θ is the element of matrix;
By x 'i、y′i、z′iIt is mapped to two bit planes and obtains the corresponding transverse and longitudinal coordinate of i pixel in original image:
The original image data and above-mentioned transformation matrix provided using interpolation device according to reading data and initialization module are provided Data calculated, obtained output result to master network export, testing result most is calculated through master network afterwards.
8. special according to the method as claimed in claim 7 for Image space transformation neural network based in internet detection Sign is, after obtaining 6 Parameter Switch matrixes, carries out resampling with image data of the bilinear interpolation to initial data input layer Obtain the image data after spatial alternation;
Formula is as follows:
Wherein,After transformation, the value in the channel c of pixel i;W and H is the width and height of original image;N is original image Certain a line;M is a certain column of original image;It is the value in the channel c of the pixel of (m, n) for coordinate in original image;For the transverse and longitudinal coordinate of pixel i in original image.
CN201910043506.3A 2019-01-17 2019-01-17 A kind of system and method for Image space transformation neural network based in internet detection Pending CN109829848A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910043506.3A CN109829848A (en) 2019-01-17 2019-01-17 A kind of system and method for Image space transformation neural network based in internet detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910043506.3A CN109829848A (en) 2019-01-17 2019-01-17 A kind of system and method for Image space transformation neural network based in internet detection

Publications (1)

Publication Number Publication Date
CN109829848A true CN109829848A (en) 2019-05-31

Family

ID=66860980

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910043506.3A Pending CN109829848A (en) 2019-01-17 2019-01-17 A kind of system and method for Image space transformation neural network based in internet detection

Country Status (1)

Country Link
CN (1) CN109829848A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778745A (en) * 2016-12-23 2017-05-31 深圳先进技术研究院 A kind of licence plate recognition method and device, user equipment
CN108399408A (en) * 2018-03-06 2018-08-14 李子衿 A kind of deformed characters antidote based on deep space converting network
CN108985217A (en) * 2018-07-10 2018-12-11 常州大学 A kind of traffic sign recognition method and system based on deep space network
CN208283401U (en) * 2018-03-05 2018-12-25 北京爱康泰科技有限责任公司 Physiology test paper and the system that the physiology test paper is detected
CN109145927A (en) * 2017-06-16 2019-01-04 杭州海康威视数字技术股份有限公司 The target identification method and device of a kind of pair of strain image

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778745A (en) * 2016-12-23 2017-05-31 深圳先进技术研究院 A kind of licence plate recognition method and device, user equipment
CN109145927A (en) * 2017-06-16 2019-01-04 杭州海康威视数字技术股份有限公司 The target identification method and device of a kind of pair of strain image
CN208283401U (en) * 2018-03-05 2018-12-25 北京爱康泰科技有限责任公司 Physiology test paper and the system that the physiology test paper is detected
CN108399408A (en) * 2018-03-06 2018-08-14 李子衿 A kind of deformed characters antidote based on deep space converting network
CN108985217A (en) * 2018-07-10 2018-12-11 常州大学 A kind of traffic sign recognition method and system based on deep space network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DANMENG8068: "图像处理基本算法--仿射变换和透视变换", 《HTTPS://BLOG.CSDN.NET/DANMENG8068/ARTICLE/DETAILS/79442792》 *

Similar Documents

Publication Publication Date Title
Li et al. Underwater scene prior inspired deep underwater image and video enhancement
CN101394573B (en) Panoramagram generation method and system based on characteristic matching
CN110033510B (en) Method and device for establishing color mapping relation for correcting rendered image color
CN110502986A (en) Identify character positions method, apparatus, computer equipment and storage medium in image
CN110400278B (en) Full-automatic correction method, device and equipment for image color and geometric distortion
CN107909640A (en) Face weight illumination method and device based on deep learning
CN108537788A (en) Camouflage painting effect evaluating method and device, computer equipment and storage medium
AU2020281143B1 (en) Creating super-resolution images
CN110942484B (en) Camera self-motion estimation method based on occlusion perception and feature pyramid matching
CN112164005A (en) Image color correction method, device, equipment and storage medium
WO2021108626A1 (en) System and method for correspondence map determination
CN113077505A (en) Optimization method of monocular depth estimation network based on contrast learning
CN115393404A (en) Double-light image registration method, device and equipment and storage medium
CN113628261B (en) Infrared and visible light image registration method in electric power inspection scene
CN116468769A (en) Depth information estimation method based on image
JP7463186B2 (en) Information processing device, information processing method, and program
CN110349209A (en) Vibrating spear localization method based on binocular vision
CN116519106B (en) Method, device, storage medium and equipment for determining weight of live pigs
CN109829848A (en) A kind of system and method for Image space transformation neural network based in internet detection
CN109886923A (en) It is a kind of for internet detection in measurement detection system and method based on machine learning
CN115937395A (en) Electrical equipment model rendering method and device, computer equipment and storage medium
CN109242793A (en) Image processing method, device, computer readable storage medium and electronic equipment
JP2022150562A (en) Image processing apparatus, image processing method, and program
CN109815875A (en) One kind is for versicolor system in internet detection
KR20220070718A (en) System for Camouflage pattern evaluation based on image analysis and Method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190531

RJ01 Rejection of invention patent application after publication