CN112686385A - Multi-site three-dimensional image oriented federal deep learning method and system - Google Patents
Multi-site three-dimensional image oriented federal deep learning method and system Download PDFInfo
- Publication number
- CN112686385A CN112686385A CN202110019107.0A CN202110019107A CN112686385A CN 112686385 A CN112686385 A CN 112686385A CN 202110019107 A CN202110019107 A CN 202110019107A CN 112686385 A CN112686385 A CN 112686385A
- Authority
- CN
- China
- Prior art keywords
- deep learning
- site
- training
- federal
- dimensional image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses a multi-site three-dimensional image-oriented federal deep learning method and a multi-site three-dimensional image-oriented federal deep learning system. According to the method, the effective characteristics of the target area can be extracted from the three-dimensional image by using the limited private data of a single site and a safe federal deep learning method for collaboratively updating the global gradient information of the federal, so that the method is beneficial to breaking through the data ownership problem and the sharing barrier between different sites under the existing legal regulations, more sites with the same kind of three-dimensional data are encouraged to add the federal to enrich the safely-aggregated global information, and a more stable and effective federal three-dimensional depth classification model with stronger universality is obtained.
Description
Technical Field
The invention relates to a three-dimensional image federal deep learning technology, in particular to a multi-site three-dimensional image-oriented federal deep learning method and a multi-site three-dimensional image-oriented federal deep learning system.
Background
The three-dimensional image is used as a real structure image of a three-dimensional world, often contains real structure information of a target, and has rich application prospects in a plurality of fields of three-dimensional point cloud segmentation and identification, real scene modeling, classification diagnosis of medical imaging and the like. Taking medical three-dimensional imaging as an example, various non-invasive imaging technologies such as CT and MRI are often used as an auxiliary means for a doctor to diagnose and treat a tested object, the current imaging technology can realize more accurate three-dimensional imaging for presenting a tested object region, and a methodology and a support of a data structure are provided for identifying whether the tested object region has a difference in different disease-related object regions.
In recent years, deep learning gradually shows great advantages and strong capabilities in the field of pattern recognition and classification of two-dimensional images, but an effective deep learning model requires large-scale labeled training samples. The three-dimensional image data has more spatial characteristic information than two-dimensional data mapped on a plane, and the cost for acquiring, accurately labeling, storing in a large quantity and executing calculation is higher than that of a two-dimensional image, so that any single site is hard to bear; meanwhile, the three-dimensional image data contains more privacy information including scenes, structures and the like, no matter sites corresponding to acquired data or data owners of the acquired data are unwilling to face the risk of privacy disclosure, and along with the increasing perfection of corresponding privacy protection regulations in China and a series of complex problems of data ownership and the like, the data quantity of multiple sites is small at present, the three-dimensional deep network model cannot be effectively trained only by means of the data quantity of a single site, and meanwhile, the centralized learning of common samples in the deep learning training model cannot be realized by concentrating or sharing original data among the sites. Therefore, there is a need to solve the problem of the method and structure for effectively utilizing the three-dimensional image with multiple sites and few samples.
Therefore, under the theory of the federal deep learning method and system facing multi-site three-dimensional images, three-dimensional image data is directly used as training data of a depth model, a three-dimensional depth network is used for capturing spatial feature information of the three-dimensional images, gradient information generated in the training process mainly comprises rich data and distribution feature information of labels, after safe aggregation is achieved through extraction and encryption, different participating sites are collaboratively helped to update parameters of a federal model in the training process, and therefore the federal deep learning method which utilizes limited private data of a single site and safe federal global gradient information to collaboratively update is designed to achieve extraction of effective features of a target area from the three-dimensional images, the method is helpful for breaking through the barriers of data ownership and sharing among different sites under the existing legal regulations, and more sites with the same type of three-dimensional data are encouraged to be added into the federal to enrich safely aggregatable global information, and obtaining the federal three-dimensional depth classification model which is more stable, effective and strong in universality.
Disclosure of Invention
The technical problems to be solved by the invention are as follows: aiming at the problems in the prior art, the invention provides a multi-site three-dimensional image-oriented federal deep learning method and a multi-site three-dimensional image-oriented federal deep learning system, which can utilize limited private data of a single site and a federal deep learning method for safely updating global gradient information to extract effective features of a target area from a three-dimensional image, are beneficial to breaking through the data ownership problem and the sharing barrier between different sites under the existing legal regulation, encourage more sites with the same type of three-dimensional data to add federal to enrich safely-aggregated global information, and obtain a more stable and effective federal three-dimensional depth classification model with stronger universality.
In order to solve the technical problems, the invention adopts the technical scheme that:
a multi-site three-dimensional image-oriented federal deep learning method comprises the following steps executed by a single site:
1) selecting a deep learning network model in the federation;
2) carrying out the training of the current round on the deep learning network model by using the private data, and jumping to the next step after completing the training of the current round;
3) sending the gradient information obtained by the training of the current round to a designated central computing server;
4) receiving global gradient information returned by the central computing server and fused with the gradient information sent by other sites;
5) updating a deep learning network model by adopting global gradient information;
6) judging whether the training needs to be continued or not, and if the training needs to be continued, jumping to the step 2); otherwise, finally completing the training to obtain the exclusive deep learning network model.
Optionally, when the gradient information obtained by the training in the current round is sent to the designated central computing server in step 3), the step refers to: and encrypting the gradient information obtained in the training of the round and then sending the encrypted gradient information to a designated central computing server.
Optionally, when the private data is used in step 2) to perform the training round on the deep learning network model, the private data refers to a three-dimensional image matrix obtained by the magnetic resonance imaging of the structure to be tested.
Optionally, the size of the three-dimensional image matrix is H × L × W, where H × W corresponds to the size of the horizontal two-dimensional image size, and L is the number of longitudinal slices in structural brain image imaging.
Optionally, before performing the current round of training on the deep learning network model by using the private data in step 2), the method further includes the step of establishing a training set and a test set of the private data: respectively taking a normal person and a patient as a subject, acquiring structural magnetic resonance imaging of the subject, preprocessing to obtain a three-dimensional image matrix of the subject, giving a label to the subject to the three-dimensional image matrix obtained by the structural magnetic resonance imaging of the subject as a two-classification data sample set, and dividing all data samples into a training set and a testing set by using an N-fold cross-validation method.
Optionally, the pre-processing refers to extracting gray matter regions in the structural image using CAT-12.
Optionally, in the step 2), when the private data is used for the current round of training of the deep learning network model, each participating station uses the same random seed to initialize the model parameters, and uses the same setting of the batch size, the iteration round number, the learning rate and other hyper-parameters, and each participating station uses the same optimizer update strategy.
Optionally, after step 3) and before step 4), the following steps of obtaining global gradient information by fusing the gradient information sent by other sites with the central computing server are further included: and receiving gradient information sent by each station after finishing the same training, multiplying the gradient information sent by each station by corresponding preset weight, summing to obtain global gradient information fused with the gradient information sent by other stations, and returning the global gradient information to each station sending the gradient information.
In addition, the invention also provides a multi-site three-dimensional image-oriented federal deep learning system, which comprises a microprocessor and a memory, wherein the microprocessor and the memory are connected with each other, the microprocessor is programmed or configured to execute the steps of the multi-site three-dimensional image-oriented federal deep learning method, or the memory stores a computer program which is programmed or configured to execute the multi-site three-dimensional image-oriented federal deep learning method.
In addition, the present invention also provides a computer readable storage medium, wherein a computer program programmed or configured to execute the foregoing multi-site three-dimensional image-oriented federal deep learning method is stored in the computer readable storage medium.
Compared with the prior art, the invention has the following advantages: the method comprises the steps that a single station respectively uses private data to carry out local training on a deep learning network model, after the local training is finished, gradient information obtained by the local training is sent to a central computing server, after the returned global gradient information is received, the deep learning network model is updated by the global gradient information, and then iterative training is selected to continue or end. The method utilizes the gradient information as shared parameter information compared with the model parameters, is more favorable for convergence of the model loss function in the process of cooperatively updating the federal model, and further improves the performance and the training efficiency of the model. According to the method, the effective characteristics of the target area can be extracted from the three-dimensional image by using the limited private data of a single site and a safe federal deep learning method for collaboratively updating the global gradient information of the federal, so that the method is beneficial to breaking through the data ownership problem and the sharing barrier between different sites under the existing legal regulations, more sites with the same kind of three-dimensional data are encouraged to add the federal to enrich the safely-aggregated global information, and a more stable and effective federal three-dimensional depth classification model with stronger universality is obtained.
Drawings
Fig. 1 is a schematic basic flow diagram of a single station of the method according to the embodiment of the present invention.
Fig. 2 is a basic flow diagram of the whole system of the method according to the embodiment of the present invention.
FIG. 3 is a schematic diagram of a federal deep learning framework training procedure in an embodiment of the present invention.
Fig. 4 is a schematic diagram illustrating the local data classification and the predicted result comparison of the local model in the federal model according to the embodiment of the present invention.
Detailed Description
Hereinafter, the method and system for multi-site three-dimensional image-oriented federal deep learning of the present invention will be further described with reference to the following embodiments of diagnosing and classifying neuropsychiatric disorders by using three-dimensional brain images of multiple medical institutions.
As shown in fig. 1, the federal deep learning method for multi-site three-dimensional images in this embodiment includes the following steps executed by a single site:
1) selecting a deep learning network model in the federation;
2) carrying out the training of the current round on the deep learning network model by using the private data, and jumping to the next step after completing the training of the current round;
3) sending the gradient information obtained by the training of the current round to a designated central computing server;
4) receiving global gradient information returned by the central computing server and fused with the gradient information sent by other sites;
5) updating a deep learning network model by adopting global gradient information;
6) judging whether the training needs to be continued or not, and if the training needs to be continued, jumping to the step 2); otherwise, finally completing the training to obtain the exclusive deep learning network model.
In this embodiment, when the gradient information obtained by the training in the current round is sent to the designated central computing server in step 3), the following steps are performed: and encrypting the gradient information obtained in the training of the round and then sending the encrypted gradient information to a designated central computing server.
In this embodiment, when the private data is used in step 2) to perform the current round of training on the deep learning network model, the private data refers to a three-dimensional image matrix obtained by the magnetic resonance imaging of the structure to be tested.
In this embodiment, the size of the three-dimensional image matrix is H × L × W, where H × W corresponds to the size of the horizontal two-dimensional image, and L is the number of longitudinal slices in structural brain image imaging.
In this embodiment, before performing the current round of training on the deep learning network model by using the private data in step 2), the method further includes the steps of establishing a training set and a test set of the private data: respectively taking a normal person and a patient as a subject, acquiring structural magnetic resonance imaging of the subject, preprocessing to obtain a three-dimensional image matrix of the subject, giving a label to the subject to the three-dimensional image matrix obtained by the structural magnetic resonance imaging of the subject as a two-classification data sample set, and dividing all data samples into a training set and a testing set by using an N-fold cross-validation method.
In this embodiment, the pre-processing is performed by extracting gray matter regions in the structural image using CAT-12.
In this embodiment, in the step 2), when the private data is used to perform the current round of training on the deep learning network model, each participating site uses the same random seed to initialize the model parameters, and uses the same setting of the batch size, the iteration round number, the learning rate and other hyper-parameters, and each participating site uses the same optimizer update strategy.
In this embodiment, after step 3) and before step 4), the following steps of obtaining global gradient information by fusing gradient information sent by other sites with the central computing server are further included: and receiving gradient information sent by each station after finishing the same training, multiplying the gradient information sent by each station by corresponding preset weight, summing to obtain global gradient information fused with the gradient information sent by other stations, and returning the global gradient information to each station sending the gradient information. It should be noted that the global gradient information returned to each station may be the same, or may be set to be different according to the actual requirements of the station.
Referring to fig. 2, from the perspective of the whole federation, the implementation steps of the federated deep learning method for multi-site three-dimensional images in the embodiment include: s1) taking the three-dimensional images of different tested persons as federal participation sites by a plurality of medical institutions respectively, wherein the three-dimensional images include but are not limited to MRI images; s2) preprocessing the acquired three-dimensional image data; s3) selecting a three-dimensional depth model structure suitable for the federal participation site; s4) determining the confidence of each federal party in the corresponding federal model and the requirement for the privacy protection level; s5) building a federal learning framework on the central computing server; s6) adding encryption gradient information of other federal sites in the training process under the condition that the privacy protection level of private data is kept within the range required by each site in the local training process of each federal participated site by using the federal learning framework, so that the local model is added with invisible private information of other participated sites in the federal in the training process to update local model parameters in a coordinated manner, thereby improving the precision and universality of the federal learning model corresponding to each participated site;
in this embodiment, the multiple sites in step S1) are medical institutions with corresponding qualifications and authorities and passing ethical tests, and before federal training, each site is evaluated to be a honest and safe site, which is used as a federal participant who is eager to participate in federal safety to obtain an effective federal model, and does not upload false information and tags, and does not maliciously reverse and attack data information of other sites. Each station acquires structural magnetic resonance imaging (srmri) data of different tested brains, and the structural magnetic resonance imaging (srmri) data can be acquired by using an instrument on site and can also be input into the structure mri data acquired in advance according to needs. When acquiring the magnetic resonance imaging (mri) data of the tested structure, the used equipment is a nuclear magnetic resonance scanner, and the scanning parameters are set according to the reasonable requirements of each participating site.
In this embodiment, step S3) includes that each participating site determines, according to the local data size, that the model can be effectively updated in the local data participation training stage when the batch size is suitable. In this embodiment, step S4) sets the main parameters of the federal framework, including a privacy protection degree parameter epsilon expected in the federal framework and a weight parameter λ of the local data dominance degree when aggregating the exclusive global gradient, which are determined by each participating site.
In this embodiment, step S5) involves building a federation framework on a third-party GPU computing server, which is used as a central computing server for securely receiving encryption information shared by all participating sites, and weighting and aggregating dedicated global gradient information for each participating site, and sending the global gradient information to the corresponding participating site for updating the federation model. The server is used as a honest and curious third party, can be connected with each participating site through a high-speed special line, has quick computing capability and does not have the storage capability of storing original information and computing results.
In the present embodiment, the detailed steps of step S6) include: s6.1) each participating site directly takes the private structure brain image after local preprocessing as input data of a model, and the image data to be tested is taken as a three-dimensional image matrix with the size of H multiplied by L multiplied by W, wherein H multiplied by W corresponds to the size of a transverse two-dimensional image, and L is the number of longitudinal slices during structural brain image imaging; s6.2) initializing a deep network model at a local site by each participating site, taking three-dimensional image data and tested classification as training samples and labels, starting a first round of iterative updating on model parameters by locally using the belonged privacy data, extracting gradients generated by the last iterative updating in the first round by each site after the first round of training is finished, realizing privacy protection of epsilon level by adding noise with effective encryption level of epsilon to shared data according to the principle of differential privacy, setting the privacy data protection degree parameter epsilon by each participating party according to local requirements, and then sharing the encrypted gradient information to a central server; s6.3) after each participating station shares the encrypted gradient information generated after the first iteration to the central server, the server weights the shared information of all stations with the local shared parameter information according to the specific weight lambda set by each participating station by the server, the parameter indicates that the weight of the shared information of all stations by a certain participating party is lambda, the weight of the rest participants is (1-lambda), the encrypted information shared by all participating stations is weighted and aggregated for each station according to the weight parameter set by each participating station to obtain the exclusive global gradient information of the station, the global gradient information is sent back to each participating station, after the global information of the specific weight is obtained by each participating station, the local model is updated again by using a guided gradient updating method to become a federation model with safe collaborative update of local private data and data of the rest participating stations, and after the federation framework collaborative update model each time, the complete federation training iteration is performed, each participating site can use local private data to carry out training of the next iteration round until a set target training round is reached; s6.4) after all training rounds are finished, the updating process of the federal framework is stopped immediately, and each participating station obtains a special federal model which is fused with data information of other stations and is most suitable for the data of the station.
The federal framework of the central computing server and the local deep network model of each participating site in this embodiment are both implemented based on Pytorch, as shown in fig. 3. In this embodiment, when constructing the training deep network model, the training specific initial parameters of the model are set as follows, the training batch size is set to 16, the initial learning rate is 0.00001, the number of iteration rounds is set to 60, the model is attenuated after the 20 th and 40 th iteration rounds, and the attenuation rate is 10-1、10-1. In this embodiment, the gradient information extraction, the shared information encryption, and the global gradient aggregation parameter setting in steps S6.2) to S6.3) are implemented by using a Pytorch framework. The embodiment uses the training set and the testing set to complete the training and testing of the deep network regression model to realize the parameter optimization,and (4) performing steps S6.2) to S6.3) by repeatedly iterating the training set, wherein when the loss of the test set in three continuous complete iteration rounds is reduced or the maximum iteration number is reached, the training process is stopped.
In order to evaluate the application function of the multi-site three-dimensional image-oriented federal deep learning method in the embodiment, the following method is adopted for verification in the embodiment: I. in this embodiment, the gradients of each participating site are shared safely, and a global weighted aggregation mode is used to assist in locally updating an exclusive federal model, that is, a weighted gradient aggregation method. In this embodiment, based on the Rest-Meta-MDD public data set, 2231 people with complete T1 structural brain images are selected as the test, the test is classified according to the international recognized scale method as the data label, the three-dimensional image matrix of the test data is extracted as the input data, and the size of each matrix is 121 × 145 × 121. II. The 23 sites with three-dimensional structure brain image data are randomly divided into 5 groups, and the 5 groups of data are used as 5 participating sites to participate in the training of the federal framework. And dividing the three-dimensional structure matrix data of each group of data into a training set and a test set by using a 5-fold cross validation method, using the training set of each group to participate in information sharing and parameter updating of the federal framework according to the flow of the figure 3, and testing the accuracy of the federal model by using the test set in each round of federal training. III, in the embodiment, each participating station uses a ResNet-10 network which is not pre-trained locally, the ResNet-10 network is modified into a three-dimensional two-classification network structure, and the classification accuracy refers to the classification accuracy of the test set after model training. In this embodiment, a comparison between the federal model classification accuracy obtained under the federal method and a local model trained only by using local private data is shown in fig. 4, and the classification accuracy of the federal model of each site is improved by 0.91% to 5.66% compared with the classification accuracy of the local model of each site. In summary, compared with the existing method, the federal deep learning method for multi-site three-dimensional images of the embodiment can effectively improve the classification accuracy and efficiency.
In addition, the embodiment also provides a multi-site three-dimensional image-oriented federal deep learning system, which includes a microprocessor and a memory, which are connected with each other, wherein the microprocessor is programmed or configured to execute the steps of the multi-site three-dimensional image-oriented federal deep learning method, or the memory stores a computer program programmed or configured to execute the multi-site three-dimensional image-oriented federal deep learning method.
In addition, the present embodiment also provides a computer-readable storage medium, in which a computer program programmed or configured to execute the foregoing multi-site three-dimensional image-oriented federal deep learning method is stored.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is directed to methods, apparatus (systems), and computer program products according to embodiments of the application wherein instructions, which execute via a flowchart and/or a processor of the computer program product, create means for implementing functions specified in the flowchart and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may occur to those skilled in the art without departing from the principle of the invention, and are considered to be within the scope of the invention.
Claims (10)
1. A multi-site three-dimensional image-oriented federal deep learning method is characterized by comprising the following steps executed by a single site:
1) selecting a deep learning network model in the federation;
2) carrying out the training of the current round on the deep learning network model by using the private data, and jumping to the next step after completing the training of the current round;
3) sending the gradient information obtained by the training of the current round to a designated central computing server;
4) receiving global gradient information returned by the central computing server and fused with the gradient information sent by other sites;
5) updating a deep learning network model by adopting global gradient information;
6) judging whether the training needs to be continued or not, and if the training needs to be continued, jumping to the step 2); otherwise, finally completing the training to obtain the exclusive deep learning network model.
2. The federal deep learning method oriented to multi-site three-dimensional images as claimed in claim 1, wherein the step 3) of sending the gradient information obtained by the training of the current round to a designated central computing server is: and encrypting the gradient information obtained in the training of the round and then sending the encrypted gradient information to a designated central computing server.
3. The federal deep learning method for multi-site three-dimensional images as claimed in claim 1, wherein in step 2), private data is used to perform the training round of the deep learning network model, and the private data refers to a three-dimensional image matrix obtained by magnetic resonance imaging of the structure to be tested.
4. The federal deep learning method for multi-site three-dimensional images as claimed in claim 3, wherein the size of the three-dimensional image matrix is H × L × W, where H × W corresponds to the size of the horizontal two-dimensional image, and L is the number of longitudinal slices in imaging the structural brain image.
5. The multi-site three-dimensional image-oriented federal deep learning method as claimed in claim 4, wherein the step 2) before the private data is used for the current round of training of the deep learning network model further comprises the steps of establishing a training set and a test set of the private data: respectively taking a normal person and a patient as a subject, acquiring structural magnetic resonance imaging of the subject, preprocessing to obtain a three-dimensional image matrix of the subject, giving a label to the subject to the three-dimensional image matrix obtained by the structural magnetic resonance imaging of the subject as a two-classification data sample set, and dividing all data samples into a training set and a testing set by using an N-fold cross-validation method.
6. The federal deep learning method for multi-site three-dimensional images as claimed in claim 5, wherein the preprocessing is to extract gray matter regions in the structural images by using CAT-12.
7. The multi-site three-dimensional image-oriented federal deep learning method as claimed in claim 1, wherein in the step 2) when private data is used for training a deep learning network model in the current round, each participating site uses the same random seed to initialize model parameters, and uses the same batch size, iteration round number, learning rate and other hyper-parameter settings, and each participating site uses the same optimizer update strategy.
8. The federal deep learning method oriented to multi-site three-dimensional images as claimed in claim 1, further comprising, after step 3) and before step 4), the following steps of obtaining global gradient information by fusing gradient information sent by other sites with a central computing server: and receiving gradient information sent by each station after finishing the same training, multiplying the gradient information sent by each station by corresponding preset weight, summing to obtain global gradient information fused with the gradient information sent by other stations, and returning the global gradient information to each station sending the gradient information.
9. A multi-site three-dimensional image-oriented federal deep learning system, comprising a microprocessor and a memory, which are connected with each other, wherein the microprocessor is programmed or configured to execute the steps of the multi-site three-dimensional image-oriented federal deep learning method according to any one of claims 1 to 8, or the memory stores therein a computer program programmed or configured to execute the multi-site three-dimensional image-oriented federal deep learning method according to any one of claims 1 to 8.
10. A computer-readable storage medium having stored thereon a computer program programmed or configured to perform the multi-site three-dimensional image-oriented federal deep learning method as claimed in any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110019107.0A CN112686385B (en) | 2021-01-07 | 2021-01-07 | Multi-site three-dimensional image oriented federal deep learning method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110019107.0A CN112686385B (en) | 2021-01-07 | 2021-01-07 | Multi-site three-dimensional image oriented federal deep learning method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112686385A true CN112686385A (en) | 2021-04-20 |
| CN112686385B CN112686385B (en) | 2023-03-07 |
Family
ID=75456291
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110019107.0A Active CN112686385B (en) | 2021-01-07 | 2021-01-07 | Multi-site three-dimensional image oriented federal deep learning method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112686385B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113177674A (en) * | 2021-05-28 | 2021-07-27 | 恒安嘉新（北京）科技股份公司 | Phishing early warning method, device, equipment and medium |
| CN113656833A (en) * | 2021-08-09 | 2021-11-16 | 浙江工业大学 | Privacy stealing defense method based on evolutionary computation under vertical federal architecture |
| CN114092769A (en) * | 2022-01-20 | 2022-02-25 | 国网江西省电力有限公司电力科学研究院 | Transformer substation multi-scene inspection analysis method based on federal learning |
| CN115310130A (en) * | 2022-08-15 | 2022-11-08 | 南京航空航天大学 | Multi-site medical data analysis method and system based on federal learning |
| WO2023030493A1 (en) * | 2021-09-02 | 2023-03-09 | 大唐移动通信设备有限公司 | Machine learning model processing method and apparatus, and storage medium |
| CN116797829A (en) * | 2023-06-13 | 2023-09-22 | 北京百度网讯科技有限公司 | Model generation method, image classification method, device, equipment and medium |
| CN116828453A (en) * | 2023-06-30 | 2023-09-29 | 华南理工大学 | Unmanned aerial vehicle edge computing privacy protection method based on self-adaptive nonlinear function |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109690554A (en) * | 2016-07-21 | 2019-04-26 | 西门子保健有限责任公司 | Method and system for the medical image segmentation based on artificial intelligence |
| US20190139642A1 (en) * | 2016-04-26 | 2019-05-09 | Ascend Hit Llc | System and methods for medical image analysis and reporting |
| KR20190096872A (en) * | 2019-07-31 | 2019-08-20 | 엘지전자 주식회사 | Method and apparatus for recognizing handwritten characters using federated learning |
| CN110600109A (en) * | 2019-09-10 | 2019-12-20 | 秦学玉 | Diagnosis and monitoring comprehensive medical system with color image fusion and fusion method thereof |
| CN110995737A (en) * | 2019-12-13 | 2020-04-10 | 支付宝(杭州)信息技术有限公司 | Gradient fusion method and device for federal learning and electronic equipment |
| CN111462097A (en) * | 2020-04-03 | 2020-07-28 | 深圳前海微众银行股份有限公司 | Image processing method, device, equipment and storage medium based on federal learning |
| CN111507481A (en) * | 2020-04-17 | 2020-08-07 | 腾讯科技（深圳）有限公司 | Federated learning system |
| CN111612168A (en) * | 2020-06-30 | 2020-09-01 | 腾讯科技（深圳）有限公司 | Management method and related device for machine learning task |
| US20200293887A1 (en) * | 2019-03-11 | 2020-09-17 | doc.ai, Inc. | System and Method with Federated Learning Model for Medical Research Applications |
| CN111814985A (en) * | 2020-06-30 | 2020-10-23 | 平安科技（深圳）有限公司 | Model training method under federated learning network and related equipment thereof |
| CN111865826A (en) * | 2020-07-02 | 2020-10-30 | 大连理工大学 | Active content caching method based on federal learning |
-
2021
- 2021-01-07 CN CN202110019107.0A patent/CN112686385B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190139642A1 (en) * | 2016-04-26 | 2019-05-09 | Ascend Hit Llc | System and methods for medical image analysis and reporting |
| CN109690554A (en) * | 2016-07-21 | 2019-04-26 | 西门子保健有限责任公司 | Method and system for the medical image segmentation based on artificial intelligence |
| US20200293887A1 (en) * | 2019-03-11 | 2020-09-17 | doc.ai, Inc. | System and Method with Federated Learning Model for Medical Research Applications |
| KR20190096872A (en) * | 2019-07-31 | 2019-08-20 | 엘지전자 주식회사 | Method and apparatus for recognizing handwritten characters using federated learning |
| CN110600109A (en) * | 2019-09-10 | 2019-12-20 | 秦学玉 | Diagnosis and monitoring comprehensive medical system with color image fusion and fusion method thereof |
| CN110995737A (en) * | 2019-12-13 | 2020-04-10 | 支付宝(杭州)信息技术有限公司 | Gradient fusion method and device for federal learning and electronic equipment |
| CN111462097A (en) * | 2020-04-03 | 2020-07-28 | 深圳前海微众银行股份有限公司 | Image processing method, device, equipment and storage medium based on federal learning |
| CN111507481A (en) * | 2020-04-17 | 2020-08-07 | 腾讯科技（深圳）有限公司 | Federated learning system |
| CN111612168A (en) * | 2020-06-30 | 2020-09-01 | 腾讯科技（深圳）有限公司 | Management method and related device for machine learning task |
| CN111814985A (en) * | 2020-06-30 | 2020-10-23 | 平安科技（深圳）有限公司 | Model training method under federated learning network and related equipment thereof |
| CN111865826A (en) * | 2020-07-02 | 2020-10-30 | 大连理工大学 | Active content caching method based on federal learning |
Non-Patent Citations (2)
| Title |
|---|
| WEIYONG GONG 等: "Palmprint Recognition Based on Convolutional Neural Network-Alexnet", 《2019 FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS (FEDCSIS)》 * |
| 吴双 等: "人工智能技术在脑肿瘤影像诊断和评估中的应用", 《中国医疗设备》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113177674A (en) * | 2021-05-28 | 2021-07-27 | 恒安嘉新（北京）科技股份公司 | Phishing early warning method, device, equipment and medium |
| CN113656833A (en) * | 2021-08-09 | 2021-11-16 | 浙江工业大学 | Privacy stealing defense method based on evolutionary computation under vertical federal architecture |
| WO2023030493A1 (en) * | 2021-09-02 | 2023-03-09 | 大唐移动通信设备有限公司 | Machine learning model processing method and apparatus, and storage medium |
| CN114092769A (en) * | 2022-01-20 | 2022-02-25 | 国网江西省电力有限公司电力科学研究院 | Transformer substation multi-scene inspection analysis method based on federal learning |
| CN114092769B (en) * | 2022-01-20 | 2022-06-14 | 国网江西省电力有限公司电力科学研究院 | Transformer substation multi-scene inspection analysis method based on federal learning |
| CN115310130A (en) * | 2022-08-15 | 2022-11-08 | 南京航空航天大学 | Multi-site medical data analysis method and system based on federal learning |
| CN115310130B (en) * | 2022-08-15 | 2023-11-17 | 南京航空航天大学 | Multi-site medical data analysis method and system based on federal learning |
| CN116797829A (en) * | 2023-06-13 | 2023-09-22 | 北京百度网讯科技有限公司 | Model generation method, image classification method, device, equipment and medium |
| CN116828453A (en) * | 2023-06-30 | 2023-09-29 | 华南理工大学 | Unmanned aerial vehicle edge computing privacy protection method based on self-adaptive nonlinear function |
| CN116828453B (en) * | 2023-06-30 | 2024-04-16 | 华南理工大学 | Unmanned aerial vehicle edge computing privacy protection method based on self-adaptive nonlinear function |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112686385B (en) | 2023-03-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112686385B (en) | Multi-site three-dimensional image oriented federal deep learning method and system | |
| WO2020215985A1 (en) | Medical image segmentation method and device, electronic device and storage medium | |
| CN111402228B (en) | Image detection method, device and computer readable storage medium | |
| Sujit et al. | Automated image quality evaluation of structural brain MRI using an ensemble of deep learning networks | |
| Yang et al. | Detecting fake images by identifying potential texture difference | |
| CN109346159B (en) | Case image classification method, device, computer equipment and storage medium | |
| CN110070935B (en) | Medical image synthesis method, classification method and device based on antagonistic neural network | |
| CN106462724A (en) | Methods and systems for verifying face images based on canonical images | |
| CN110414350A (en) | The face false-proof detection method of two-way convolutional neural networks based on attention model | |
| CN106295501A (en) | The degree of depth based on lip movement study personal identification method | |
| Yang et al. | Active object reconstruction using a guided view planner | |
| CN108596900B (en) | Thyroid-associated ophthalmopathy medical image data processing device and method, computer-readable storage medium and terminal equipment | |
| CN110084109A (en) | A kind of low-resolution face image recognition methods, device, electronic equipment and storage medium | |
| CN106560807A (en) | Big-data-based face charming authentication method and system | |
| CN110136111A (en) | A kind of heart movement estimation method, system and terminal device | |
| Kwok et al. | Enhanced variational U-Net for weather forecasting | |
| CN114612618A (en) | Image generation method, device, equipment, storage medium and computer program product | |
| CN109564685A (en) | The lobe of the lung of robust is divided | |
| Gao et al. | Federated learning-driven collaborative diagnostic system for metastatic breast cancer | |
| CN117390455B (en) | Data processing method and device, storage medium and electronic equipment | |
| CN116612341B (en) | Image processing method, device, equipment and storage medium for object counting | |
| CN115147420B (en) | Inter-slice correlation detection model training method, detection method and electronic equipment | |
| CN117274274A (en) | Priori knowledge-based domain generalization medical image segmentation method and system | |
| CN106295602A (en) | A kind of face identification method and device | |
| Xiao et al. | Super-resolution reconstruction of remote sensing image by fusion of receptive field and attention |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |