CN110288024B - Image classifier construction and image recognition method and system based on prototype network few-sample learning - Google Patents

Image classifier construction and image recognition method and system based on prototype network few-sample learning Download PDF

Info

Publication number
CN110288024B
CN110288024B CN201910563501.3A CN201910563501A CN110288024B CN 110288024 B CN110288024 B CN 110288024B CN 201910563501 A CN201910563501 A CN 201910563501A CN 110288024 B CN110288024 B CN 110288024B
Authority
CN
China
Prior art keywords
sample
image
prototype
samples
query
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910563501.3A
Other languages
Chinese (zh)
Other versions
CN110288024A (en
Inventor
周风余
刘晓倩
江连杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN201910563501.3A priority Critical patent/CN110288024B/en
Publication of CN110288024A publication Critical patent/CN110288024A/en
Application granted granted Critical
Publication of CN110288024B publication Critical patent/CN110288024B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses an image classifier construction and image recognition method and system based on prototype network few-sample learning, wherein the image classifier construction method comprises the following steps: receiving an image training set, and constructing a sample set and a query set from the image training set based on an epsilon mode; extracting n-dimensional features of all sample sets and query sets; calculating the prototype of each type of sample in the sample set according to Bregman divergence; calculating the distance from each sample in the query set to various sample prototypes; calculating the possibility of each sample in the query set to various samples; calculating the loss of various samples in the query set, and calculating the average loss of all samples; and optimizing a model for modeling the distance distribution among the samples by using a prototype network based on measurement by using a sample loss function to obtain the image classifier. The image identification method comprises the steps of receiving an image to be identified; and determining the type of the image to be identified according to the image classifier to obtain an image identification result.

Description

Image classifier construction and image recognition method and system based on prototype network few-sample learning
Technical Field
The disclosure belongs to the technical field of image recognition of computer vision, and relates to an image classifier construction and image recognition method and system based on prototype network few-sample learning.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
Deep learning has recently made great progress in the field of computer vision, but it requires a lot of labeled data and many iterations to train a lot of parameters, and meanwhile, labeled data is difficult to obtain in real life, and labeling of images is time-consuming and labor-consuming, which limits its scalability, especially in the face of new never-appeared categories, and also limits its applicability. On the contrary, human beings can achieve better target recognition effect without direct supervision information. Therefore, how to obtain a classifier with excellent generalization performance and strong robustness through a small amount of labeled data training is a problem worthy of research, namely the research of the problem of few samples.
The few sample learning generally contains three data sets: trailing set, support set, and test set. the training set and the support/test have different label spaces, while the support set and the test set have the same label space. For the support set containing C categories, each category containing K samples, we call the C-way K-shot problem.
Prototype networks are one of the research ideas for metric-based, sample-less learning: under a mixed density estimate of the exponential family distribution satisfying Bregman divergence, the prototype expression for each class is the mean of the support set in each dimension in the feature space, and then the image recognition classification problem becomes the nearest neighbor in the feature space. The prototype network based on the measurement models the distance distribution among samples, however, the inventor finds in the research process that the loss function based on the prototype network only considers that the homogeneous samples are close and does not consider that the heterogeneous samples are far.
Disclosure of Invention
Aiming at the defects in the prior art, one or more embodiments of the disclosure provide an image classifier construction and image recognition method and system based on prototype network learning with few samples, and the trained classifier effectively realizes better measurement of sample similarity by using a small amount of samples and extracts more migratory features, thereby achieving better effect when recognizing class samples not encountered in the training process.
According to an aspect of one or more embodiments of the present disclosure, there is provided an image classifier construction method based on prototype network sample-less learning.
An image classifier construction method based on prototype network few-sample learning comprises the following steps:
receiving an image training set, and constructing a sample set and a query set from the image training set based on an epsilon mode;
extracting n-dimensional features of all sample sets and query sets;
calculating the prototype of each type of sample in the sample set according to Bregman divergence;
calculating the distance from each sample in the query set to various sample prototypes;
calculating the possibility of each sample in the query set to various samples;
calculating the loss of various samples in the query set, and calculating the average loss of all samples;
and optimizing a model for modeling the distance distribution among the samples by using a prototype network based on measurement by using a sample loss function to obtain the image classifier.
Further, in the method, the Euclidean distance or the cosine distance is adopted to calculate the distance from each sample in the query set to various types of sample prototypes.
Further, in the method, the computing of the likelihood of each sample in the query set into classes of samples, class k sample xqTo class k sample prototype pkIs that
Figure GDA0002994268160000031
Further, in the method, the loss of the kth type sample in the loss of each type of sample in the calculation query set is:
Figure GDA0002994268160000032
according to an aspect of one or more embodiments of the present disclosure, there is provided a computer-readable storage medium.
A computer-readable storage medium, wherein a plurality of instructions are stored, the instructions are suitable for being loaded by a processor of a terminal device and executing the image classifier construction method based on prototype network few-sample learning.
According to an aspect of one or more embodiments of the present disclosure, there is provided a terminal device.
A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; the computer readable storage medium is used for storing a plurality of instructions which are suitable for being loaded by a processor and executing the image classifier construction method based on prototype network few-sample learning.
According to an aspect of one or more embodiments of the present disclosure, there is provided an image classifier building apparatus based on prototype network sample-less learning.
An image classifier construction device based on prototype network few-sample learning, based on the image classifier construction method based on prototype network few-sample learning, comprises:
the training set constructing module is configured to receive an image training set, and construct a sample set and a query set from the image training set based on an epsilon mode;
a feature extraction module configured to extract n-dimensional features of all sample sets and query sets;
a sample prototype calculation module configured to calculate a prototype for each type of sample in the sample set according to Bregman divergence;
the distance calculation module is configured to calculate the distance from each sample in the query set to various types of sample prototypes;
a likelihood calculation module configured to calculate a likelihood of each sample in the query set to each type of sample;
the sample loss calculation module is configured to calculate the loss of various samples in the query set and calculate the average loss of all the samples;
and the model optimization module is configured to optimize the model for modeling the distance distribution among the samples by using the prototype network based on the measurement by adopting the sample loss function to obtain the image classifier.
According to an aspect of one or more embodiments of the present disclosure, there is provided an image recognition method based on prototype network sample-less learning.
An image recognition method based on prototype network few-sample learning comprises the following steps:
receiving an image to be identified;
and determining the type of the image to be identified according to the image classifier obtained by the image classifier construction method based on prototype network less sample learning to obtain an image identification result.
According to an aspect of one or more embodiments of the present disclosure, there is provided a computer-readable storage medium.
A computer-readable storage medium having stored therein a plurality of instructions adapted to be loaded by a processor of a terminal device and to execute a prototype-network-based low-sample learning image recognition method.
According to an aspect of one or more embodiments of the present disclosure, there is provided a terminal device.
A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; the computer readable storage medium is used for storing a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the image recognition method based on prototype network few-sample learning.
According to an aspect of one or more embodiments of the present disclosure, there is provided an image recognition apparatus based on prototype network sample-less learning.
An image recognition device based on prototype network learning with less samples, based on the image recognition method based on prototype network learning with less samples, comprising:
an image receiving module configured to receive an image to be recognized;
and the image identification module is configured to determine the type of the image to be identified according to the image classifier obtained by the image classifier construction method based on prototype network learning with few samples, so as to obtain an image identification result.
The beneficial effect of this disclosure:
according to the image classifier construction and image recognition method and system based on prototype network learning with few samples, the similar sample approach and the heterogeneous sample distance are considered in the loss function, the common characteristics of different samples can be measured in the training process based on the epi-sode structure, the characteristics with mobility can be extracted, and the better classification result and the better image recognition result can be achieved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the application and, together with the description, serve to explain the application and are not intended to limit the application.
Fig. 1 is a flowchart of an image classifier construction method based on prototype network low-sample learning according to one or more embodiments of the present disclosure;
FIG. 2 is a flow diagram of a prototype network-based low-sample learning algorithm provided by one or more embodiments of the present disclosure;
fig. 3 is a flowchart of an image recognition method based on prototype network learning with few samples according to one or more embodiments of the present disclosure.
The specific implementation mode is as follows:
technical solutions in one or more embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in one or more embodiments of the present disclosure, and it is to be understood that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments, which can be derived by one of ordinary skill in the art from one or more embodiments of the disclosure without making any creative effort, shall fall within the scope of protection of the disclosure.
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the disclosure. Unless defined otherwise, all technical and scientific terms used have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
It is noted that the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of methods and systems according to various embodiments of the present disclosure. It should be noted that each block in the flowchart or block diagrams may represent a module, a segment, or a portion of code, which may comprise one or more executable instructions for implementing the logical function specified in the respective embodiment. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Without conflict, the embodiments and features of the embodiments in the present disclosure may be combined with each other, and the present disclosure will be further described with reference to the drawings and the embodiments.
Example one
According to an aspect of one or more embodiments of the present disclosure, there is provided an image classifier construction method based on prototype network sample-less learning.
As shown in fig. 1, an image classifier construction method based on prototype network few-sample learning includes:
step S1: receiving an image training set, and constructing a sample set and a query set from the image training set based on an epsilon mode;
step S2: extracting n-dimensional features of all sample sets and query sets;
step S3: calculating the prototype of each type of sample in the sample set according to Bregman divergence;
step S4: calculating the distance from each sample in the query set to various sample prototypes;
step S5: calculating the possibility of each sample in the query set to various samples;
step S6: calculating the loss of various samples in the query set, and calculating the average loss of all samples;
step S7: and optimizing a model for modeling the distance distribution among the samples by using a prototype network based on measurement by using a sample loss function to obtain the image classifier.
In step S1 of one or more embodiments of the present disclosure, a sample set and a query set are constructed for a training set based on an epadiode manner.
Randomly selecting N in a training setcClass samples are used for the epsilon, and N is randomly selected for each class samplesForming sample set by one sample, and randomly selecting N from the rest samplesqOne sample constitutes a query set. In this embodiment, Nc=5,Ns=1,Nq=19。
In one or more embodiments of the present disclosure, in step S2, features of all sample sets and query sets are extracted. The method is characterized in that sample set and query set are output through a fully-connected layer of a model built in advance, and 64-dimensional characteristics are output.
In one or more embodiments of the present disclosure, in step S3, a prototype is calculated for each type of sample in sample set. Prototype of class k samples according to Bregman divergence
Figure GDA0002994268160000081
Wherein N issIs the number of samples selected per category, SkIs sample set, f (x)i) Is a feature of sample set.
In step S4 of one or more embodiments of the present disclosure, each sample x in query set is calculatedqDistance d (f (x)) to prototype of each type of sampleq),pk) The euclidean distance or the cosine distance may be used.
The distance calculation in step S4 may use a common distance calculation, such as using euclidean distance or cosine distance to calculate the distance from each sample in the query set to the prototype of each type of sample.
In step S5 of one or more embodiments of the present disclosure, each sample x in query set is calculatedqTo the possibility of various types of sample prototypes. Class k sample xqPossibility of belonging to class k samples
Figure GDA0002994268160000082
In one or more embodiments of the present disclosure, step S6, the loss of the kth type sample in the query set is calculated.
Figure GDA0002994268160000083
Calculating the loss of all samples in the query set
Figure GDA0002994268160000091
In one or more embodiments of the present disclosure, step S7, the model is optimized according to a loss function. The model was optimized using a random gradient descent.
The pseudo code for a particular algorithm is shown in table 1.
TABLE 1
Figure GDA0002994268160000092
Figure GDA0002994268160000101
Example two
According to an aspect of one or more embodiments of the present disclosure, there is provided a computer-readable storage medium.
A computer-readable storage medium, wherein a plurality of instructions are stored, the instructions are suitable for being loaded by a processor of a terminal device and executing the image classifier construction method based on prototype network few-sample learning.
EXAMPLE III
According to an aspect of one or more embodiments of the present disclosure, there is provided a terminal device.
A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; the computer readable storage medium is used for storing a plurality of instructions which are suitable for being loaded by a processor and executing the image classifier construction method based on prototype network few-sample learning.
These computer-executable instructions, when executed in a device, cause the device to perform methods or processes described in accordance with various embodiments of the present disclosure.
In the present embodiments, a computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for performing various aspects of the present disclosure. The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described in this disclosure may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present disclosure may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present disclosure by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Example four
According to an aspect of one or more embodiments of the present disclosure, there is provided an image classifier building apparatus based on prototype network sample-less learning.
An image classifier construction device based on prototype network few-sample learning, based on the image classifier construction method based on prototype network few-sample learning, comprises:
the training set constructing module is configured to receive an image training set, and construct a sample set and a query set from the image training set based on an epsilon mode;
a feature extraction module configured to extract n-dimensional features of all sample sets and query sets;
a sample prototype calculation module configured to calculate a prototype for each type of sample in the sample set according to Bregman divergence;
the distance calculation module is configured to calculate the distance from each sample in the query set to various types of sample prototypes;
a likelihood calculation module configured to calculate a likelihood of each sample in the query set to each type of sample;
the sample loss calculation module is configured to calculate the loss of various samples in the query set and calculate the average loss of all the samples;
and the model optimization module is configured to optimize the model for modeling the distance distribution among the samples by using the prototype network based on the measurement by adopting the sample loss function to obtain the image classifier.
It should be noted that although several modules or sub-modules of the device are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the modules described above may be embodied in one module in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module described above may be further divided into embodiments by a plurality of modules.
EXAMPLE five
According to an aspect of one or more embodiments of the present disclosure, there is provided an image recognition method based on prototype network sample-less learning.
As shown in fig. 3, an image recognition method based on prototype network learning with few samples includes:
receiving an image to be identified;
and determining the type of the image to be identified according to the image classifier obtained by the image classifier construction method based on prototype network less sample learning to obtain an image identification result.
EXAMPLE six
According to an aspect of one or more embodiments of the present disclosure, there is provided a computer-readable storage medium.
A computer-readable storage medium having stored therein a plurality of instructions adapted to be loaded by a processor of a terminal device and to execute a prototype-network-based low-sample learning image recognition method.
EXAMPLE seven
According to an aspect of one or more embodiments of the present disclosure, there is provided a terminal device.
A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; the computer readable storage medium is used for storing a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the image recognition method based on prototype network few-sample learning.
Example eight
According to an aspect of one or more embodiments of the present disclosure, there is provided an image recognition apparatus based on prototype network sample-less learning.
An image recognition device based on prototype network learning with less samples, based on the image recognition method based on prototype network learning with less samples, comprising:
an image receiving module configured to receive an image to be recognized;
and the image identification module is configured to determine the type of the image to be identified according to the image classifier obtained by the image classifier construction method based on prototype network learning with few samples, so as to obtain an image identification result.
It should be noted that although several modules or sub-modules of the device are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the modules described above may be embodied in one module in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module described above may be further divided into embodiments by a plurality of modules.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (9)

1. A method for constructing an image classifier based on prototype network few-sample learning is characterized by comprising the following steps:
receiving an image training set, and constructing a sample set and a query set from the image training set based on an epsilon mode;
extracting n-dimensional features of all sample sets and query sets;
calculating the prototype of each type of sample in the sample set according to Bregman divergence;
calculating the distance from each sample in the query set to various sample prototypes;
calculating the possibility of each sample in the query set to various samples; calculating the probability of each sample in the query set to a class of samples, class k sample xqTo class k sample prototype pkIs that
Figure FDA0002994268150000011
Calculating the loss of various samples in the query set, and calculating the average loss of all samples; the loss of the kth sample in the loss of the various samples in the calculation query set is as follows:
Figure FDA0002994268150000012
and optimizing a model for modeling the distance distribution among the samples by using a prototype network based on measurement by using a sample loss function to obtain the image classifier.
2. The method of claim 1, wherein the Euclidean distance or cosine distance is used to calculate the distance from each sample in the query set to the prototype of each type of sample.
3. A computer-readable storage medium having stored thereon a plurality of instructions, wherein the instructions are adapted to be loaded by a processor of a terminal device and to perform the method for constructing an image classifier based on prototype network learning with few samples according to any of claims 1-2.
4. A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; a computer-readable storage medium storing instructions adapted to be loaded by a processor and to perform the method of constructing an image classifier based on prototype network learning with few samples according to any of claims 1-2.
5. An image recognition device based on prototype network learning-less, characterized in that, based on the image classifier construction method based on prototype network learning-less according to any one of claims 1-2, it includes:
the training set constructing module is configured to receive an image training set, and construct a sample set and a query set from the image training set based on an epsilon mode;
a feature extraction module configured to extract n-dimensional features of all sample sets and query sets;
a sample prototype calculation module configured to calculate a prototype for each type of sample in the sample set according to Bregman divergence;
the distance calculation module is configured to calculate the distance from each sample in the query set to various types of sample prototypes;
a likelihood calculation module configured to calculate a likelihood of each sample in the query set to each type of sample;
the sample loss calculation module is configured to calculate the loss of various samples in the query set and calculate the average loss of all the samples;
and the model optimization module is configured to optimize the model for modeling the distance distribution among the samples by using the prototype network based on the measurement by adopting the sample loss function to obtain the image classifier.
6. An image recognition method based on prototype network few-sample learning is characterized by comprising the following steps:
receiving an image to be identified;
the image classifier obtained according to the image classifier construction method based on prototype network few-sample learning of any one of claims 1-2 determines the type of the image to be recognized, and obtains the image recognition result.
7. A computer-readable storage medium having stored thereon instructions adapted to be loaded by a processor of a terminal device and to execute the method of claim 6.
8. A terminal device comprising a processor and a computer-readable storage medium, the processor being configured to implement instructions; a computer-readable storage medium storing instructions adapted to be loaded by a processor and to perform the method of claim 6.
9. An image recognition device based on prototype network learning-less, characterized in that, based on the image recognition method based on prototype network learning-less according to claim 6, it includes:
an image receiving module configured to receive an image to be recognized;
and the image identification module is configured to determine the type of the image to be identified according to the image classifier obtained by the image classifier construction method based on prototype network learning with few samples, so as to obtain an image identification result.
CN201910563501.3A 2019-06-26 2019-06-26 Image classifier construction and image recognition method and system based on prototype network few-sample learning Active CN110288024B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910563501.3A CN110288024B (en) 2019-06-26 2019-06-26 Image classifier construction and image recognition method and system based on prototype network few-sample learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910563501.3A CN110288024B (en) 2019-06-26 2019-06-26 Image classifier construction and image recognition method and system based on prototype network few-sample learning

Publications (2)

Publication Number Publication Date
CN110288024A CN110288024A (en) 2019-09-27
CN110288024B true CN110288024B (en) 2021-08-27

Family

ID=68006179

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910563501.3A Active CN110288024B (en) 2019-06-26 2019-06-26 Image classifier construction and image recognition method and system based on prototype network few-sample learning

Country Status (1)

Country Link
CN (1) CN110288024B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111046910A (en) * 2019-11-12 2020-04-21 北京三快在线科技有限公司 Image classification, relation network model training and image annotation method and device
CN110909643B (en) * 2019-11-14 2022-10-28 北京航空航天大学 Remote sensing ship image small sample classification method based on nearest neighbor prototype representation
CN113032534A (en) * 2019-12-24 2021-06-25 中国移动通信集团四川有限公司 Dialog text classification method and electronic equipment
CN111797893B (en) * 2020-05-26 2021-09-14 华为技术有限公司 Neural network training method, image classification system and related equipment
CN112150471B (en) * 2020-09-23 2023-09-05 创新奇智(上海)科技有限公司 Semantic segmentation method and device based on few samples, electronic equipment and storage medium
CN113610151B (en) * 2021-08-05 2022-05-03 哈尔滨理工大学 Small sample image classification system based on prototype network and self-encoder
CN114844583B (en) * 2022-03-30 2023-04-07 电子科技大学 End-to-end communication receiving method based on prototype network

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109800811A (en) * 2019-01-24 2019-05-24 吉林大学 A kind of small sample image-recognizing method based on deep learning
CN109919183A (en) * 2019-01-24 2019-06-21 北京大学 A kind of image-recognizing method based on small sample, device, equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109800811A (en) * 2019-01-24 2019-05-24 吉林大学 A kind of small sample image-recognizing method based on deep learning
CN109919183A (en) * 2019-01-24 2019-06-21 北京大学 A kind of image-recognizing method based on small sample, device, equipment and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Principal characteristic networks for few-shot learning;Yan Zheng 等;《J. Vis. Commun. Image R.》;20190210;全文 *
Prototypical Networks for Few-shot Learning;Jake Snell 等;《arXiv:1703.05175v2 [cs.LG]》;20170119;第1-3、5-6页 *
通过创建虚拟样本的小样本人脸识别统计学习方法;温津伟 等;《计算机研究与发展》;20070731;全文 *

Also Published As

Publication number Publication date
CN110288024A (en) 2019-09-27

Similar Documents

Publication Publication Date Title
CN110288024B (en) Image classifier construction and image recognition method and system based on prototype network few-sample learning
US11462007B2 (en) System for simplified generation of systems for broad area geospatial object detection
CN109829433B (en) Face image recognition method and device, electronic equipment and storage medium
CN111582453B (en) Method and device for generating neural network model
CN108629414B (en) Deep hash learning method and device
CN114419570B (en) Point cloud data identification method and device, electronic equipment and storage medium
CN111178039B (en) Model training method and device, and text processing method and device
CN110019849B (en) Attention mechanism-based video attention moment retrieval method and device
CN110019845B (en) Community evolution analysis method and device based on knowledge graph
CN113223011B (en) Small sample image segmentation method based on guide network and full-connection conditional random field
CN111091068B (en) Density estimation model training method and device, storage medium and electronic equipment
CN112926647A (en) Model training method, domain name detection method and device
CN112257689A (en) Training and recognition method of face recognition model, storage medium and related equipment
US20170262755A1 (en) Supporting generation of a response to an inquiry
US9378466B2 (en) Data reduction in nearest neighbor classification
CN112905832B (en) Complex background fine-grained image retrieval system and method
CN115392234A (en) Text representation method, word representation method, corresponding device, medium and equipment
CN111915703B (en) Image generation method and device
CN114625860A (en) Contract clause identification method, device, equipment and medium
CN110084264B (en) Image classification method and device based on improved random gradient descent
CN115512693A (en) Audio recognition method, acoustic model training method, device and storage medium
CN113627241B (en) Background suppression method and system for re-identification of pedestrians
Ahmad et al. Toward cross‐domain object detection in artwork images using improved YoloV5 and XGBoosting
CN116029291B (en) Keyword recognition method, keyword recognition device, electronic equipment and storage medium
CN110362808B (en) Text analysis method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant