CN109118491A - A kind of image partition method based on deep learning, system and electronic equipment - Google Patents

A kind of image partition method based on deep learning, system and electronic equipment Download PDF

Info

Publication number
CN109118491A
CN109118491A CN201810852143.3A CN201810852143A CN109118491A CN 109118491 A CN109118491 A CN 109118491A CN 201810852143 A CN201810852143 A CN 201810852143A CN 109118491 A CN109118491 A CN 109118491A
Authority
CN
China
Prior art keywords
characteristic pattern
image
sampling
network model
deep learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810852143.3A
Other languages
Chinese (zh)
Inventor
邬晶晶
张涌
许强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN201810852143.3A priority Critical patent/CN109118491A/en
Publication of CN109118491A publication Critical patent/CN109118491A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)

Abstract

The application belongs to technical field of image segmentation, in particular to a kind of image partition method based on deep learning, system and electronic equipment.The image partition method based on deep learning includes: step a: original image is normalized;Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts the characteristic pattern comprising global semantic information in input picture, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, obtain final characteristic pattern;Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation result.Present application addresses gradient disappearance problems common in convolutional neural networks, also network can be allowed to be more easier to train, and converge to a better segmentation result.

Description

A kind of image partition method based on deep learning, system and electronic equipment
Technical field
The application belongs to technical field of image segmentation, in particular to a kind of image partition method based on deep learning is System and electronic equipment.
Background technique
Image Engineering is broadly divided into three levels: image procossing, image analysis and image understanding.The target of image segmentation is Each pixel in image is classified, i.e., using image target object pixel and surrounding pixel between discontinuity or The similitude of person's target internal is cut into picture the segmentation block of multiple zonules.Image segmentation is most basic in Image Engineering It is a part being most difficult to, is the important bridge contacted between image procossing and image analysis.Image segmentation mode mainly includes Binary segmentation, semantic segmentation and example segmentation.It is all research binary segmentation mostly inside traditional image processing algorithm, It is that the pixel of picture is divided into two class of foreground and background.Traditional partitioning algorithm mainly includes edge detection (such as canny), threshold Value segmentation (such as OTSU), region growing, cluster (such as k-means) and graph model (such as grabcut).
Present data are more and more, many large-scale segmentation databases all disclose (PASCAL VOC, Cityscape, Places, DAVIS etc.), the computing capability of computer is further promoted, and GPU is taken seriously in the ability that processing image calculates, Effect is most preferably based on the certain methods of deep learning, such as FCN (Fully Convolutional Networks, full volume Product network), Deeplab (semantic segmentation network), U-Net (Convolutional Networks for Biomedical Image Segmentation, this network is for dividing cell image), DRN (Deep Residual Network, depth residual error Network), PSPNet (Pyramid Scene Parsing Network, semantic segmentation network) etc..Deep learning is relative to tradition Method the advantages of be the feature that can automatically extract image, either semantic segmentation or example segmentation could set up end To the network structure at end, and the semantic information in picture can be extracted to a certain extent, and because the picture of training becomes More, the model that training obtains also has better generalization ability.
Wherein article [Philipp Fischer, ThomasBrox.U-Net:Convolutional Networks for Biomedical Image Segmentation.Medical Image Computing and Computer-Assisted Intervention (MICCAI) .2015.] in propose U-Net network structure image segmentation network is divided into two parts, U- Net network structure a constricted path (left side) and an extensions path (right side) as shown in Figure 1, be made of.Constricted path is abided by The typical architecture of convolutional network is followed, it is by 2 3*3 without filling up convolution (unpaddedconvolutions) and maximum pond Repeated application composition.Down-sampling all doubles number of channels each time, and each step in extensions path all carries out characteristic pattern Then up-sampling carries out 2*2 convolution for feature port number and reduces half, the characteristic value figure heap cut corresponding to constricted path It is folded.It inputs picture and from left to right successively passes through layer-by-layer convolution sum pond, the feature extracted has more abstract semantic letter Breath, the process of down-sampling can get the global semantic information of whole picture step by step, but the resolution ratio of characteristic pattern But it is reducing always, this also causes the characteristic pattern on more the right although to have more abstract semantic information but is also lost many spaces It is clear to will lead to segmentation result obscure boundary in this way for detailed information.Although up-sampling itself can restore some spatial detail information. But this be it is far from being enough, the spy that there is higher resolution on some left sides is also added in U-Net during up-sampling Sign figure (higher resolution often means that more spatial detail information).Article, which is taken, directly copied to be cropped to again and above adopts The same size of master drawing piece, more abstract because the feature of extraction is also more efficient as convolution number increases, the figure of up-sampling Piece be after undergoing multiple convolution relatively efficiently and abstract picture, then characteristic pattern and left side be less abstract but high resolution Feature image stacked, allowing in the characteristic pattern after up-sampling not only has abstract semantic information, also has more Spatial detail information.
In conclusion deficiency existing for existing image partition method is:
1), traditional images partitioning algorithm
Edge detection is realized simply, but the edge found is not exclusively the edge of target object.Threshold segmentation is generally used Do binary segmentation, but either whole figure or part all poorly automatically find a suitable threshold value.Region is raw The general quality for relatively depending on initial point of the quality of long segmentation result.Cluster the line for removing to use image that can be relatively good Reason, color and spatial information, but need one kind that can indicate image texture, the method for color and spatial information well. The feature of hand-designed is not particularly suited for whole pictures.
2), the image segmentation of deep learning
Although deep neural network has surmounted conventional segmentation methods from far away, CNN is utilized (Convolutional Neural Network, convolutional neural networks) do image segmentation and still remain some problems, such as special Levying resolution ratio reduces, and object, cannot be well to global contextual information modeling etc. there are multiple dimensioned.Although U-Net is used The method of down-sampled-up-sampling, but picture too many spatial detail information can be lost during down-sampled.DRN is used Empty convolution goes the resolution ratio for guaranteeing the smallest characteristic pattern will not be too small, but also only alleviates asking for feature resolution reduction Topic, resolution ratio do not reduce, and the video memory of video card does not accommodate the characteristic pattern of too many image, the characteristic polymorphic of the picture extracted It can become smaller.PSPNet is gone to obtain global context information with the method in pyramid pond, and effect well, but is split Image edge it is still relatively rough.So segmentation is still the field of a very open and worth research.
Summary of the invention
This application provides a kind of image partition method based on deep learning, system and electronic equipments, it is intended at least exist One of above-mentioned technical problem in the prior art is solved to a certain extent.
To solve the above-mentioned problems, this application provides following technical solutions:
A kind of image partition method based on deep learning, comprising the following steps:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts Characteristic pattern comprising global semantic information in input picture, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, Obtain final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation knot Fruit.
The technical solution that the embodiment of the present application is taken further include: described that normalizing is carried out to original image in the step a Change processing specifically: original image is normalized using deep learning normalization mode GN.
The technical solution that the embodiment of the present application is taken further include: in the step b, the ResUNet network model is The network model combined using ResNet and U-Net, including 2N+1 Resblock, N number of average pond layer, N number of up-sampling layer And 2 (N+1) a convolutional layers, the ResUNet network model are full convolutional network, the characteristic pattern of extraction is big → small → big Change procedure.
The technical solution that the embodiment of the present application is taken further include: under the ResUNet network model includes bottom-up Sampling module and top-down up-sampling module, for the down sample module during down-sampling, the characteristic pattern of extraction is by big Become smaller, obtains the global semantic information of the input picture;The up-sampling module makes the characteristic pattern by small using up-sampling Become larger, and carry out characteristic pattern stacking after each up-sampling, had not only been possessed high-resolution but also had the feature of abstract low resolution Figure.
A kind of another technical solution that the embodiment of the present application is taken are as follows: image segmentation system based on deep learning, comprising:
Normalize module: for original image to be normalized;
Characteristic pattern extraction module: described for the image after the normalization to be inputted ResUNet network model ResUNet network model extracts the characteristic pattern comprising global semantic information in input picture, and adopt to the characteristic pattern Sample and the processing of characteristic pattern stacking, obtain final characteristic pattern;
As a result output module: for the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and it is defeated Image segmentation result out.
The technical solution that the embodiment of the present application is taken further include: place is normalized to original image in the normalization module Reason specifically: original image is normalized using deep learning normalization mode GN.
The technical solution that the embodiment of the present application is taken further include: the ResUNet network model is using ResNet and U- The network model that Net is combined, including 2N+1 Resblock, N number of average pond layer, N number of up-sampling layer and 2 (N+1) a volumes Lamination, the ResUNet network model are full convolutional network, and the characteristic pattern of extraction is big → small → big change procedure.
The technical solution that the embodiment of the present application is taken further include: under the ResUNet network model includes bottom-up Sampling module and top-down up-sampling module, for the down sample module during down-sampling, the characteristic pattern of extraction is by big Become smaller, obtains the global semantic information of the input picture;The up-sampling module makes the characteristic pattern by small using up-sampling Become larger, and carry out characteristic pattern stacking after each up-sampling, had not only been possessed high-resolution but also had the feature of abstract low resolution Figure.
The another technical solution that the embodiment of the present application is taken are as follows: a kind of electronic equipment, comprising:
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by one processor, and described instruction is by described at least one It manages device to execute, so that at least one described processor is able to carry out the following of the above-mentioned image partition method based on deep learning Operation:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts Characteristic pattern comprising global semantic information in input picture, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, Obtain final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation knot Fruit.
Compared with the existing technology, the embodiment of the present application generate beneficial effect be: the embodiment of the present application based on depth Image partition method, system and the electronic equipment of study carry out image segmentation using the network model that ResNet and U-Net is combined, The spatial detail information of original image can be retained, and different scale object of different shapes can be divided.It is tied at entire network In structure, the application replaces common convolutional layer using Resblock, solves the problems, such as gradient disappearance common in convolutional neural networks, Also network can be allowed to be more easier to train, converges to a better segmentation result.The application utilizes GroupNormalization Instead of BatchNormalization, it can efficiently solve in the case where limiting BatchSize very little due to video memory, normalize institute The mean value and variance that need calculate the problem of inaccuracy, can allow network that can also converge in the case where the BatchSize of very little Good result.
Detailed description of the invention
Fig. 1 is U-Net network structure;
Fig. 2 is the flow chart of the image partition method based on deep learning of the embodiment of the present application;
Fig. 3 is the structure chart of the preferred ResUNet network model of the embodiment of the present application;
Fig. 4 is that the up-sampling of the embodiment of the present application and characteristic pattern stack schematic diagram;
Fig. 5 is the structural schematic diagram of the image segmentation system based on deep learning of the embodiment of the present application;
Fig. 6 is the hardware device structural representation of the image partition method provided by the embodiments of the present application based on deep learning Figure.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood The application is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the application, not For limiting the application.
Referring to Fig. 2, being the flow chart of the image partition method based on deep learning of the embodiment of the present application.The application is real Apply the image partition method based on deep learning of example the following steps are included:
Step 100: using deep learning normalization mode GN (GroupNormalization, group normalization) to original graph As being normalized;
In step 100, BatchNormalization (batch normalization, write a Chinese character in simplified form BN) is a kind of common method for normalizing, But its performance is influenced by Batch Size (batch size).It is limited by hardware device, BatchSize generally can not be arranged For very big number, and too small BatchSize can make to normalize required mean value and variance and calculate inaccuracy, cause under performance Drop.Because BN be it is normalized in this dimension of batch, when Batch Size very little, the mean value calculated and Variance cannot reflect the true distribution of data distribution, will lead to inconsistent in training, verifying, the parameter of test three phases.And GN is then that the dimension of characteristic pattern is first become [N, G, C//G, H, W] by [N, C, H, W], the dimension after normalization be [C//G, H, W] (N is quantity, and C is port number, and H is characterized figure height, W be characterized figure is wide, and G is a group number), therefore, in the small feelings of BatchSize Under condition, the normalization performance of GN does not receive influence yet, and network is made to be easier to train.
Step 200: by after normalization image input ResUNet network model, ResUNet network model utilize from bottom to On down sample module extract the characteristic pattern from large to small comprising global semantic information in image, and using from top upwards upper Sampling module carries out up-sampling to characteristic pattern and characteristic pattern stacking is handled, and obtains final characteristic pattern;
In step 200, the ResUNet network model that the application is combined using ResNet and U-Net, ResUNet network mould Type is made of 2N+1 Resblock, N number of average pond layer, N number of up-sampling layer and 2 (N+1) a convolutional layers, and network can basis The number of specific data set adjustment ResNetblock.As shown in figure 3, being the preferred ResUNet network model of the embodiment of the present application Structure chart.It includes 7 Resblock, 3 average pond layers, 3 up-sampling layers and 8 convolutional layers.Whole network is Full convolutional network can both reduce the parameter of network not by the way of connecting entirely to pixel classifications in this way, can also reduce Time of the front and back of network to deduction.Whole network characteristic pattern is big → small → big change procedure: in network characterization figure from big During becoming smaller, characteristic pattern includes more and more abstract semantic information;In network characterization figure from the small process to become larger In, characteristic pattern not only only include semantic information abundant, but also by means of up-sample and stack than itself have it is higher The characteristic pattern of the low level of resolution ratio, making its characteristic pattern also includes enough spatial detail information, so that image segmentation knot Fruit, which can revert to, has same resolution ratio with input picture.
As shown in figure 3, whole network is divided into bottom-up down sample module and up-sampling module two top-down Point, wherein network is a bottom-up down sample module from ResNetblock 4 is input to, during down-sampling, feature Figure from large to small, makes it obtain more global semantic informations.Assuming that the size of input picture is 512*512, successively pass through 3 times After average pond, the characteristic pattern size of input ResNetblock 2 is 256*256, inputs the characteristic pattern of ResNetblock 3 Size is 128*128, and the characteristic pattern size of input ResNetblock 4 is 64*64, and 3 average ponds are so that characteristic pattern is more next It is smaller, and continuous convolution process keeps port number more and more.Because of the reduction of resolution ratio, keeps characteristic pattern more efficient and take out As also losing many spatial detail information.
Network is a top-down up-sampling module from ResNetblock 5 to output, in upper sampling process, is utilized Up-sampling makes characteristic pattern change from small to big, and by up-sampling three times, characteristic pattern is by 64*64 → 128*128 → 256*256 → 512* 512, a characteristic pattern, which is had, after up-sampling every time stacks.Detailed process is as shown in figure 4, be the up-sampling of the embodiment of the present application And characteristic pattern stacks schematic diagram.For example the characteristic pattern after last time up-sampling is 512*512, and passes through ResNetblock Characteristic pattern after 1 stacks, and characteristic pattern at this time had not only possessed high-resolution characteristic pattern, but also had the feature of abstract low resolution Figure, and final characteristic pattern includes the different size of characteristic pattern of each level, can retain enough spatial detail information, have Conducive to the object of segmentation different scale, so that prediction result is more accurate.
The application replaces common convolutional layer using ResNet, solves asking for gradient disappearance common in convolutional neural networks Topic.In order to guarantee to export the ability to express of feature, the application keeps ResNetblock port number successively progressive, network can be allowed wide Degree becomes smaller, and overcomes the problems, such as that gradient disappears, also can control number of parameters, and network is allowed to be more easier to train, and converges to one more preferably Segmentation result.Due to the jump connection function of ResNetblock, even if model will not be allowed in the case where network relatively depth Tend to be saturated, ResNet can be allowed to have lower convergence loss.
Step 300: to up-sampling and stacking that treated that characteristic pattern is classified pixel-by-pixel, and export image segmentation knot Fruit.
It is different from classical convolutional neural networks mode classification in step 300, the ResUNet network of the embodiment of the present application Model is not that the feature vector for obtaining regular length using full articulamentum is classified, it can receive the input of arbitrary dimension Image makes characteristic pattern be restored to the identical size of input picture, so as to produce one to each pixel using up-sampling A prediction, while remaining the spatial detail information in original input picture.
Referring to Fig. 5, being the structural schematic diagram of the image segmentation system based on deep learning of the embodiment of the present application.This Shen Please the image segmentation system based on deep learning of embodiment include that normalization module, characteristic pattern extraction module and result export mould Block.
Normalization module: for original image to be normalized using deep learning normalization mode GN;Wherein, BatchNormalization (batch normalization, write a Chinese character in simplified form BN) is a kind of common method for normalizing, but its performance is by Batch The influence of Size (batch size).It is limited by hardware device, BatchSize generally can not be set as very big number, and too small BatchSize can make to normalize required mean value and variance again and calculate inaccuracy, cause performance to decline.Because BN be Normalized in this dimension of batch, when Batch Size very little, the mean value and variance calculated cannot reflect number According to the true distribution of distribution, will lead to inconsistent in training, verifying, the parameter of test three phases.And GN is then first by feature The dimension of figure becomes [N, G, C//G, H, W] by [N, C, H, W], and the dimension after normalization is that [C//G, H, W] (N is quantity, and C is Port number, H are characterized figure height, and it is wide that W is characterized figure, and G is a group number), therefore, in the case where BatchSize is small, the normalization of GN Performance does not receive influence yet, and network is made to be easier to train.
Characteristic pattern extraction module: ResUNet network model, ResUNet network mould are inputted for the image after normalizing Type extracts the characteristic pattern from large to small comprising global semantic information in image using bottom-up down sample module, and utilizes Up-sampling and the processing of characteristic pattern stacking are carried out to characteristic pattern from upward up-sampling module is pushed up, obtain final characteristic pattern;This Shen The ResUNet network model that please be combined using ResNet and U-Net, ResUNet network model is by 2N+1 Resblock, N number of Average pond layer, N number of up-sampling layer and a convolutional layer of 2 (N+1) are constituted, and network can be adjusted according to specific data set The number of ResNetblock.
The preferred ResUNet network model of the embodiment of the present application is including on 7 Resblock, 3 average pond layers, 3 Sample level and 8 convolutional layers.Whole network is full convolutional network, not by the way of connecting entirely to pixel classifications, in this way Both the parameter that network can have been reduced can also reduce the front and back of network to the time of deduction.Whole network characteristic pattern is big → small → big change procedure: in network characterization figure from during becoming smaller greatly, characteristic pattern includes more and more abstract semanteme Information;During network characterization figure is from small become larger, characteristic pattern not only only includes semantic information abundant, but also by It in up-sampling and stacks than itself there is the characteristic pattern of the low level of higher resolution, making its characteristic pattern also includes enough skies Between detailed information so that image segmentation result, which can be reverted to, has same resolution ratio with input picture.
Whole network is divided into bottom-up down sample module and top-down up-sampling module two parts, wherein net Network is from ResNetblock 4 is input to for a bottom-up down sample module, and during down-sampling, characteristic pattern is by becoming greatly It is small, so that it is obtained more global semantic informations.Assuming that the size of input picture is 512*512, successively by 3 average ponds Later, the characteristic pattern size for inputting ResNetblock 2 is 256*256, and the characteristic pattern size of input ResNetblock 3 is 128*128, the characteristic pattern size of input ResNetblock 4 are 64*64,3 average ponds so that characteristic pattern is smaller and smaller, and Continuous convolution process keeps port number more and more.Because of the reduction of resolution ratio, keeps characteristic pattern more efficiently and abstract, also lose Many spatial detail information.
Network is a top-down up-sampling module from ResNetblock 5 to output, in upper sampling process, is utilized Up-sampling makes characteristic pattern change from small to big, and by up-sampling three times, characteristic pattern is by 64*64 → 128*128 → 256*256 → 512* 512, a characteristic pattern, which is had, after up-sampling every time stacks.For example the characteristic pattern after last time up-sampling is 512*512, It is stacked with by the characteristic pattern after ResNetblock 1, characteristic pattern at this time had not only possessed high-resolution characteristic pattern, but also had abstract Low resolution characteristic pattern, and final characteristic pattern include the different size of characteristic pattern of each level, can retain enough Spatial detail information, be conducive to divide different scale object so that prediction result is more accurate.
The application replaces common convolutional layer using ResNet, solves asking for gradient disappearance common in convolutional neural networks Topic.In order to guarantee to export the ability to express of feature, the application keeps ResNetblock port number successively progressive, network can be allowed wide Degree becomes smaller, and overcomes the problems, such as that gradient disappears, also can control number of parameters, and network is allowed to be more easier to train, and converges to one more preferably Segmentation result.Due to the jump connection function of ResNetblock, even if model will not be allowed in the case where network relatively depth Tend to be saturated, ResNet can be allowed to have lower convergence loss.
As a result output module: for up-sampling and stacking that treated characteristic pattern being classified pixel-by-pixel, and figure is exported As segmentation result.The ResUNet network model of the embodiment of the present application is not to obtain the feature of regular length using full articulamentum Vector is classified, it can receive the input picture of arbitrary dimension, so that characteristic pattern is restored to input picture phase using up-sampling Same size, so as to produce a prediction to each pixel, while it is thin to remain the space in original input picture Save information.
Fig. 6 is the hardware device structural representation of the image partition method provided by the embodiments of the present application based on deep learning Figure.As shown in fig. 6, the equipment includes one or more processors and memory.It takes a processor as an example, which may be used also To include: input system and output system.
Processor, memory, input system and output system can be connected by bus or other modes, in Fig. 6 with For being connected by bus.
Memory as a kind of non-transient computer readable storage medium, can be used for storing non-transient software program, it is non-temporarily State computer executable program and module.Processor passes through operation non-transient software program stored in memory, instruction And module realizes the place of above method embodiment thereby executing the various function application and data processing of electronic equipment Reason method.
Memory may include storing program area and storage data area, wherein storing program area can storage program area, extremely Application program required for a few function;It storage data area can storing data etc..In addition, memory may include that high speed is random Memory is accessed, can also include non-transient memory, a for example, at least disk memory, flush memory device or other are non- Transient state solid-state memory.In some embodiments, it includes the memory remotely located relative to processor that memory is optional, this A little remote memories can pass through network connection to processing system.The example of above-mentioned network includes but is not limited to internet, enterprise Intranet, local area network, mobile radio communication and combinations thereof.
Input system can receive the number or character information of input, and generate signal input.Output system may include showing Display screen etc. shows equipment.
One or more of module storages in the memory, are executed when by one or more of processors When, execute the following operation of any of the above-described embodiment of the method:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts Characteristic pattern comprising global semantic information in input picture, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, Obtain final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation knot Fruit.
Method provided by the embodiment of the present application can be performed in the said goods, has the corresponding functional module of execution method and has Beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to method provided by the embodiments of the present application.
The embodiment of the present application provides a kind of non-transient (non-volatile) computer storage medium, and the computer storage is situated between Matter is stored with computer executable instructions, the executable following operation of the computer executable instructions:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts Characteristic pattern comprising global semantic information in input picture, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, Obtain final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation knot Fruit.
The embodiment of the present application provides a kind of computer program product, and the computer program product is non-temporary including being stored in Computer program on state computer readable storage medium, the computer program include program instruction, when described program instructs When being computer-executed, the computer is made to execute following operation:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts Characteristic pattern comprising global semantic information in input picture, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, Obtain final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation knot Fruit.
The image partition method based on deep learning, system and electronic equipment of the embodiment of the present application use ResNet and U- The network model that Net is combined carries out image segmentation, can retain the spatial detail information of original image, and can divide different rulers Spend object of different shapes.In entire network configuration, the application replaces common convolutional layer using Resblock, solves convolution Common gradient disappearance problem, also can allow network to be more easier to train in neural network, converge to a better segmentation result. The application replaces BatchNormalization using GroupNormalization, can efficiently solve since video memory limits In the case where BatchSize very little, the problem that required mean value and variance calculate inaccuracy is normalized, network can be allowed in very little BatchSize in the case where can also converge to good result.
The foregoing description of the disclosed embodiments makes professional and technical personnel in the field can be realized or use the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, defined herein General Principle can realize in other embodiments without departing from the spirit or scope of the application.Therefore, this Shen These embodiments shown in the application please be not intended to be limited to, and are to fit to special with principle disclosed in the present application and novelty The consistent widest scope of point.

Claims (9)

1. a kind of image partition method based on deep learning, which comprises the following steps:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts input Characteristic pattern comprising global semantic information in image, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, it obtains Final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation result.
2. the image partition method according to claim 1 based on deep learning, which is characterized in that in the step a, It is described that original image is normalized specifically: normalizing is carried out to original image using deep learning normalization mode GN Change processing.
3. the image partition method according to claim 2 based on deep learning, which is characterized in that in the step b, The ResUNet network model is the network model combined using ResNet and U-Net, including 2N+1 Resblock, N number of is put down Equal pond layer, N number of up-sampling layer and 2 (N+1) a convolutional layers, the ResUNet network model are full convolutional network, extraction Characteristic pattern is big → small → big change procedure.
4. the image partition method according to claim 3 based on deep learning, which is characterized in that the ResUNet net Network model includes bottom-up down sample module and top-down up-sampling module, and the down sample module is in down-sampling mistake Cheng Zhong, the characteristic pattern of extraction from large to small, obtain the global semantic information of the input picture;The up-sampling module utilizes upper Sampling makes the characteristic pattern change from small to big, and carries out characteristic pattern stacking after each up-sampling, not only possessed high-resolution but also There is the characteristic pattern of abstract low resolution.
5. a kind of image segmentation system based on deep learning characterized by comprising
Normalize module: for original image to be normalized;
Characteristic pattern extraction module: for the image after the normalization to be inputted ResUNet network model, the ResUNet net Characteristic pattern comprising global semantic information in network model extraction input picture, and up-sampling and characteristic pattern are carried out to the characteristic pattern Stacking processing, obtains final characteristic pattern;
As a result output module: for treated that characteristic pattern is classified pixel-by-pixel to the up-sampling and stacking, and figure is exported As segmentation result.
6. the image segmentation system according to claim 5 based on deep learning, which is characterized in that the normalization module Original image is normalized specifically: place is normalized to original image using deep learning normalization mode GN Reason.
7. the image segmentation system according to claim 6 based on deep learning, which is characterized in that the ResUNet net Network model is the network model combined using ResNet and U-Net, including 2N+1 Resblock, N number of pond layer that is averaged, N number of Up-sample layer and 2 (N+1) a convolutional layers, the ResUNet network model is full convolutional network, the characteristic pattern of extraction be it is big → Small → big change procedure.
8. the image segmentation system according to claim 7 based on deep learning, which is characterized in that the ResUNet net Network model includes bottom-up down sample module and top-down up-sampling module, and the down sample module is in down-sampling mistake Cheng Zhong, the characteristic pattern of extraction from large to small, obtain the global semantic information of the input picture;The up-sampling module utilizes upper Sampling makes the characteristic pattern change from small to big, and carries out characteristic pattern stacking after each up-sampling, not only possessed high-resolution but also There is the characteristic pattern of abstract low resolution.
9. a kind of electronic equipment, comprising:
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by one processor, and described instruction is by least one described processor It executes, so that at least one described processor is able to carry out above-mentioned 1 to 4 described in any item image segmentations based on deep learning The following operation of method:
Step a: original image is normalized;
Step b: the image after the normalization is inputted into ResUNet network model, the ResUNet network model extracts input Characteristic pattern comprising global semantic information in image, and up-sampling and the processing of characteristic pattern stacking are carried out to the characteristic pattern, it obtains Final characteristic pattern;
Step c: to the up-sampling and stacking, treated that characteristic pattern is classified pixel-by-pixel, and exports image segmentation result.
CN201810852143.3A 2018-07-30 2018-07-30 A kind of image partition method based on deep learning, system and electronic equipment Pending CN109118491A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810852143.3A CN109118491A (en) 2018-07-30 2018-07-30 A kind of image partition method based on deep learning, system and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810852143.3A CN109118491A (en) 2018-07-30 2018-07-30 A kind of image partition method based on deep learning, system and electronic equipment

Publications (1)

Publication Number Publication Date
CN109118491A true CN109118491A (en) 2019-01-01

Family

ID=64863589

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810852143.3A Pending CN109118491A (en) 2018-07-30 2018-07-30 A kind of image partition method based on deep learning, system and electronic equipment

Country Status (1)

Country Link
CN (1) CN109118491A (en)

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109727259A (en) * 2019-01-07 2019-05-07 哈尔滨理工大学 A kind of retinal images partitioning algorithm based on residual error U-NET network
CN109785435A (en) * 2019-01-03 2019-05-21 东易日盛家居装饰集团股份有限公司 A kind of wall method for reconstructing and device
CN109886984A (en) * 2019-01-22 2019-06-14 浙江大学 Utilize the image Accurate Segmentation method of front and back scape gray scale difference and deep learning network
CN109886971A (en) * 2019-01-24 2019-06-14 西安交通大学 A kind of image partition method and system based on convolutional neural networks
CN109948510A (en) * 2019-03-14 2019-06-28 北京易道博识科技有限公司 A kind of file and picture example dividing method and device
CN110047068A (en) * 2019-04-19 2019-07-23 山东大学 MRI brain tumor dividing method and system based on pyramid scene analysis network
CN110084816A (en) * 2019-03-21 2019-08-02 深圳大学 Method for segmenting objects, device, computer readable storage medium and computer equipment
CN110084297A (en) * 2019-04-23 2019-08-02 东华大学 A kind of image semanteme alignment structures towards small sample
CN110322435A (en) * 2019-01-20 2019-10-11 北京工业大学 A kind of gastric cancer pathological image cancerous region dividing method based on deep learning
CN110321923A (en) * 2019-05-10 2019-10-11 上海大学 Object detection method, system and the medium of different scale receptive field Feature-level fusion
CN110781756A (en) * 2019-09-29 2020-02-11 北京化工大学 Urban road extraction method and device based on remote sensing image
CN110807376A (en) * 2019-10-17 2020-02-18 北京化工大学 Method and device for extracting urban road based on remote sensing image
CN110889854A (en) * 2019-10-16 2020-03-17 深圳信息职业技术学院 Sketch component segmentation method, system and device based on multi-scale deep learning and storage medium
CN110942464A (en) * 2019-11-08 2020-03-31 浙江工业大学 PET image segmentation method fusing 2-dimensional and 3-dimensional models
CN110942465A (en) * 2019-11-08 2020-03-31 浙江工业大学 ResUnet-based 3-view PET image segmentation method
CN110992306A (en) * 2019-11-04 2020-04-10 国网河北省电力有限公司检修分公司 Method and device for segmenting deteriorated insulator in infrared image based on deep learning
CN111028242A (en) * 2019-11-27 2020-04-17 中国科学院深圳先进技术研究院 Automatic tumor segmentation system and method and electronic equipment
CN111031239A (en) * 2019-12-05 2020-04-17 Oppo广东移动通信有限公司 Image processing method and apparatus, electronic device, and computer-readable storage medium
CN111047598A (en) * 2019-11-04 2020-04-21 华北电力大学(保定) Deep learning-based ultraviolet discharge light spot segmentation method and device for power transmission and transformation equipment
CN111612789A (en) * 2020-06-30 2020-09-01 征图新视(江苏)科技股份有限公司 Defect detection method based on improved U-net network
CN111627032A (en) * 2020-05-14 2020-09-04 安徽慧软科技有限公司 CT image body organ automatic segmentation method based on U-Net network
CN111709293A (en) * 2020-05-18 2020-09-25 杭州电子科技大学 Chemical structural formula segmentation method based on Resunet neural network
WO2020233129A1 (en) * 2019-05-17 2020-11-26 深圳先进技术研究院 Image super-resolution and coloring method and system, and electronic device
CN112200226A (en) * 2020-09-27 2021-01-08 北京达佳互联信息技术有限公司 Image processing method based on reinforcement learning, image processing method and related device
CN112508001A (en) * 2020-12-03 2021-03-16 安徽理工大学 Coal gangue positioning method based on multispectral waveband screening and improved U-Net
CN113052849A (en) * 2021-04-16 2021-06-29 中国科学院苏州生物医学工程技术研究所 Automatic segmentation method and system for abdominal tissue image
CN113239808A (en) * 2021-05-14 2021-08-10 广州广电运通金融电子股份有限公司 Deep learning-based fingerprint texture extraction method, system, device and storage medium
CN113362338A (en) * 2021-05-24 2021-09-07 国能朔黄铁路发展有限责任公司 Rail segmentation method, device, computer equipment and rail segmentation processing system
CN113610712A (en) * 2021-08-04 2021-11-05 西南大学 Resolution improvement method and device, electronic equipment and storage medium
CN113610704A (en) * 2021-09-30 2021-11-05 北京奇艺世纪科技有限公司 Image generation method, device, equipment and readable storage medium
CN114445631A (en) * 2022-01-29 2022-05-06 智道网联科技(北京)有限公司 Pavement full-factor image semantic segmentation method and device based on deep learning
CN114913189A (en) * 2022-05-31 2022-08-16 东北大学 Coal gangue image segmentation method, device and equipment based on deep neural network
CN116071622A (en) * 2023-04-06 2023-05-05 广州思德医疗科技有限公司 Stomach image recognition model construction method and system based on deep learning
WO2024125156A1 (en) * 2022-12-14 2024-06-20 华为技术有限公司 Feature extraction unit, feature extraction method, and related device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551036A (en) * 2015-12-10 2016-05-04 中国科学院深圳先进技术研究院 Training method and device for deep learning network
CN105590319A (en) * 2015-12-18 2016-05-18 华南理工大学 Method for detecting image saliency region for deep learning
CN107516316A (en) * 2017-07-19 2017-12-26 郑州禅图智能科技有限公司 It is a kind of that the method that focus mechanism is split to static human image is introduced in FCN
CN108053417A (en) * 2018-01-30 2018-05-18 浙江大学 A kind of lung segmenting device of the 3DU-Net networks based on mixing coarse segmentation feature
CN108256440A (en) * 2017-12-27 2018-07-06 长沙学院 A kind of eyebrow image segmentation method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551036A (en) * 2015-12-10 2016-05-04 中国科学院深圳先进技术研究院 Training method and device for deep learning network
CN105590319A (en) * 2015-12-18 2016-05-18 华南理工大学 Method for detecting image saliency region for deep learning
CN107516316A (en) * 2017-07-19 2017-12-26 郑州禅图智能科技有限公司 It is a kind of that the method that focus mechanism is split to static human image is introduced in FCN
CN108256440A (en) * 2017-12-27 2018-07-06 长沙学院 A kind of eyebrow image segmentation method and system
CN108053417A (en) * 2018-01-30 2018-05-18 浙江大学 A kind of lung segmenting device of the 3DU-Net networks based on mixing coarse segmentation feature

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
徐晨阳等: "《超声图像神经分割方法研究》", 《北京邮电大学学报》 *
杨文: "《何恺明团队最新力作:群组归一化(Group Normalization)》", 《HTTP://WWW.LEIPHONE.COM/NEWS/201803/UMVCCCCIN2YPXU7T.HTML》 *

Cited By (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109785435A (en) * 2019-01-03 2019-05-21 东易日盛家居装饰集团股份有限公司 A kind of wall method for reconstructing and device
CN109727259A (en) * 2019-01-07 2019-05-07 哈尔滨理工大学 A kind of retinal images partitioning algorithm based on residual error U-NET network
CN110322435A (en) * 2019-01-20 2019-10-11 北京工业大学 A kind of gastric cancer pathological image cancerous region dividing method based on deep learning
CN109886984A (en) * 2019-01-22 2019-06-14 浙江大学 Utilize the image Accurate Segmentation method of front and back scape gray scale difference and deep learning network
CN109886971A (en) * 2019-01-24 2019-06-14 西安交通大学 A kind of image partition method and system based on convolutional neural networks
CN109948510A (en) * 2019-03-14 2019-06-28 北京易道博识科技有限公司 A kind of file and picture example dividing method and device
CN110084816A (en) * 2019-03-21 2019-08-02 深圳大学 Method for segmenting objects, device, computer readable storage medium and computer equipment
CN110084816B (en) * 2019-03-21 2021-04-06 深圳大学 Object segmentation method, device, computer-readable storage medium and computer equipment
WO2020186563A1 (en) * 2019-03-21 2020-09-24 深圳大学 Object segmentation method and apparatus, computer readable storage medium, and computer device
CN110047068A (en) * 2019-04-19 2019-07-23 山东大学 MRI brain tumor dividing method and system based on pyramid scene analysis network
CN110084297B (en) * 2019-04-23 2023-09-15 东华大学 Image semantic alignment system for small samples
CN110084297A (en) * 2019-04-23 2019-08-02 东华大学 A kind of image semanteme alignment structures towards small sample
CN110321923A (en) * 2019-05-10 2019-10-11 上海大学 Object detection method, system and the medium of different scale receptive field Feature-level fusion
CN110321923B (en) * 2019-05-10 2021-05-04 上海大学 Target detection method, system and medium for fusion of different-scale receptive field characteristic layers
WO2020233129A1 (en) * 2019-05-17 2020-11-26 深圳先进技术研究院 Image super-resolution and coloring method and system, and electronic device
CN110781756A (en) * 2019-09-29 2020-02-11 北京化工大学 Urban road extraction method and device based on remote sensing image
CN110889854B (en) * 2019-10-16 2023-12-05 深圳信息职业技术学院 Sketch part segmentation method, system, device and storage medium based on multi-scale deep learning
CN110889854A (en) * 2019-10-16 2020-03-17 深圳信息职业技术学院 Sketch component segmentation method, system and device based on multi-scale deep learning and storage medium
CN110807376A (en) * 2019-10-17 2020-02-18 北京化工大学 Method and device for extracting urban road based on remote sensing image
CN110992306B (en) * 2019-11-04 2022-04-22 国网河北省电力有限公司检修分公司 Method and device for segmenting deteriorated insulator in infrared image based on deep learning
CN110992306A (en) * 2019-11-04 2020-04-10 国网河北省电力有限公司检修分公司 Method and device for segmenting deteriorated insulator in infrared image based on deep learning
CN111047598A (en) * 2019-11-04 2020-04-21 华北电力大学(保定) Deep learning-based ultraviolet discharge light spot segmentation method and device for power transmission and transformation equipment
CN111047598B (en) * 2019-11-04 2023-09-01 华北电力大学(保定) Deep learning-based ultraviolet discharge light spot segmentation method and device for power transmission and transformation equipment
CN110942464A (en) * 2019-11-08 2020-03-31 浙江工业大学 PET image segmentation method fusing 2-dimensional and 3-dimensional models
CN110942465A (en) * 2019-11-08 2020-03-31 浙江工业大学 ResUnet-based 3-view PET image segmentation method
CN111028242A (en) * 2019-11-27 2020-04-17 中国科学院深圳先进技术研究院 Automatic tumor segmentation system and method and electronic equipment
CN111031239A (en) * 2019-12-05 2020-04-17 Oppo广东移动通信有限公司 Image processing method and apparatus, electronic device, and computer-readable storage medium
CN111031239B (en) * 2019-12-05 2021-06-18 Oppo广东移动通信有限公司 Image processing method and apparatus, electronic device, and computer-readable storage medium
CN111627032A (en) * 2020-05-14 2020-09-04 安徽慧软科技有限公司 CT image body organ automatic segmentation method based on U-Net network
CN111709293B (en) * 2020-05-18 2023-10-03 杭州电子科技大学 Chemical structural formula segmentation method based on Resunet neural network
CN111709293A (en) * 2020-05-18 2020-09-25 杭州电子科技大学 Chemical structural formula segmentation method based on Resunet neural network
CN111612789A (en) * 2020-06-30 2020-09-01 征图新视(江苏)科技股份有限公司 Defect detection method based on improved U-net network
CN112200226A (en) * 2020-09-27 2021-01-08 北京达佳互联信息技术有限公司 Image processing method based on reinforcement learning, image processing method and related device
CN112200226B (en) * 2020-09-27 2021-11-05 北京达佳互联信息技术有限公司 Image processing method based on reinforcement learning, image processing method and related device
CN112508001A (en) * 2020-12-03 2021-03-16 安徽理工大学 Coal gangue positioning method based on multispectral waveband screening and improved U-Net
CN113052849A (en) * 2021-04-16 2021-06-29 中国科学院苏州生物医学工程技术研究所 Automatic segmentation method and system for abdominal tissue image
CN113052849B (en) * 2021-04-16 2024-01-26 中国科学院苏州生物医学工程技术研究所 Automatic abdominal tissue image segmentation method and system
CN113239808A (en) * 2021-05-14 2021-08-10 广州广电运通金融电子股份有限公司 Deep learning-based fingerprint texture extraction method, system, device and storage medium
CN113362338A (en) * 2021-05-24 2021-09-07 国能朔黄铁路发展有限责任公司 Rail segmentation method, device, computer equipment and rail segmentation processing system
CN113610712A (en) * 2021-08-04 2021-11-05 西南大学 Resolution improvement method and device, electronic equipment and storage medium
CN113610704A (en) * 2021-09-30 2021-11-05 北京奇艺世纪科技有限公司 Image generation method, device, equipment and readable storage medium
CN113610704B (en) * 2021-09-30 2022-02-08 北京奇艺世纪科技有限公司 Image generation method, device, equipment and readable storage medium
CN114445631A (en) * 2022-01-29 2022-05-06 智道网联科技(北京)有限公司 Pavement full-factor image semantic segmentation method and device based on deep learning
CN114913189A (en) * 2022-05-31 2022-08-16 东北大学 Coal gangue image segmentation method, device and equipment based on deep neural network
CN114913189B (en) * 2022-05-31 2024-07-02 东北大学 Coal gangue image segmentation method, device and equipment based on deep neural network
WO2024125156A1 (en) * 2022-12-14 2024-06-20 华为技术有限公司 Feature extraction unit, feature extraction method, and related device
CN116071622B (en) * 2023-04-06 2024-01-12 广州思德医疗科技有限公司 Stomach image recognition model construction method and system based on deep learning
CN116071622A (en) * 2023-04-06 2023-05-05 广州思德医疗科技有限公司 Stomach image recognition model construction method and system based on deep learning

Similar Documents

Publication Publication Date Title
CN109118491A (en) A kind of image partition method based on deep learning, system and electronic equipment
US11257279B2 (en) Systems and methods for providing non-parametric texture synthesis of arbitrary shape and/or material data in a unified framework
US11798132B2 (en) Image inpainting method and apparatus, computer device, and storage medium
Sheng et al. Improving video temporal consistency via broad learning system
CN111242127B (en) Vehicle detection method with granularity level multi-scale characteristic based on asymmetric convolution
CN109949255A (en) Image rebuilding method and equipment
EP4404148A1 (en) Image processing method and apparatus, and computer-readable storage medium
CN106709872B (en) A kind of rapid image ultra-resolution ratio reconstructing method
CN110533594A (en) Model training method, image rebuilding method, storage medium and relevant device
WO2022152009A1 (en) Target detection method and apparatus, and device and storage medium
Spizhevoi et al. OpenCV 3 Computer Vision with Python Cookbook: Leverage the power of OpenCV 3 and Python to build computer vision applications
CN112884668A (en) Lightweight low-light image enhancement method based on multiple scales
JP7085600B2 (en) Similar area enhancement method and system using similarity between images
CN113313625A (en) Ink and wash painting artistic style conversion method, system, computer equipment and storage medium
JP2024508867A (en) Image clustering method, device, computer equipment and computer program
CN117437423A (en) Weak supervision medical image segmentation method and device based on SAM collaborative learning and cross-layer feature aggregation enhancement
CN112101344A (en) Video text tracking method and device
Ullah et al. DSFMA: Deeply supervised fully convolutional neural networks based on multi-level aggregation for saliency detection
Zhao et al. Saliency map-aided generative adversarial network for raw to rgb mapping
CN117830102A (en) Image super-resolution restoration method, device, computer equipment and storage medium
CN103324956B (en) A kind of seat statistical method based on distributed video detection
CN103678888A (en) Cardiac blood flowing indicating and displaying method based on Euler fluid simulation algorithm
WO2023109086A1 (en) Character recognition method, apparatus and device, and storage medium
CN114724175B (en) Pedestrian image detection network, pedestrian image detection method, pedestrian image training method, electronic device and medium
Feng et al. Study on the optimization of CNN based on image identification

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190101