CN110751112B - Computer vision-based mouse brain map drawing auxiliary system and method - Google Patents

Computer vision-based mouse brain map drawing auxiliary system and method Download PDF

Info

Publication number
CN110751112B
CN110751112B CN201911017554.1A CN201911017554A CN110751112B CN 110751112 B CN110751112 B CN 110751112B CN 201911017554 A CN201911017554 A CN 201911017554A CN 110751112 B CN110751112 B CN 110751112B
Authority
CN
China
Prior art keywords
mouse brain
microscopic image
module
atlas
computer vision
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911017554.1A
Other languages
Chinese (zh)
Other versions
CN110751112A (en
Inventor
赵梓豪
邹乔莎
袁磊
史传进
何苗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fudan University
Original Assignee
Fudan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fudan University filed Critical Fudan University
Priority to CN201911017554.1A priority Critical patent/CN110751112B/en
Publication of CN110751112A publication Critical patent/CN110751112A/en
Application granted granted Critical
Publication of CN110751112B publication Critical patent/CN110751112B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/206Drawing of charts or graphs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30016Brain
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Computer Graphics (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a computer vision-based mouse brain map drawing auxiliary system and a computer vision-based mouse brain map drawing auxiliary method, wherein the system comprises a preprocessing module; the input end of the detection module is connected with the first output end of the pretreatment module, and the neuron cell body is detected; the input end of the registration module is connected with the second output end of the preprocessing module, and registration comparison is carried out; the input end of the identification partitioning module is connected with the output end of the registration module, and the mouse brain microscopic image is partitioned; and the first input end of the mapping module is connected with the output end of the detection module, the second input end of the mapping module is connected with the output end of the identification partition module, and the neuron cell bodies and the mouse brain microscopic image are mapped one by one to complete auxiliary drawing of the mouse brain map. The invention solves the problems of insufficient accuracy and incomplete application of the existing software and deep learning algorithm, and realizes the automatic and semi-automatic operation of the auxiliary system for drawing the brain map of the mouse by means of image decomposition and image feature extraction and detection by means of a computer vision algorithm.

Description

一种基于计算机视觉的小鼠脑图谱绘制辅助系统及方法A mouse brain mapping assistance system and method based on computer vision

技术领域Technical field

本发明涉及计算机视觉软件领域,具体涉及一种基于计算机视觉的小鼠脑图谱绘制辅助系统及方法。The invention relates to the field of computer vision software, and in particular to a mouse brain atlas drawing assistance system and method based on computer vision.

背景技术Background technique

脑连接图谱的绘制对于深入理解脑功能及模拟脑神经网络,开发类脑人工智能具有重要的意义。作为神经网络的基础单位,神经元根据形态、发育、连接、功能以及基因表达的不同可被分为多种类型。不同类型的神经元之间的相互连接所形成的神经环路是承载各种脑功能的技术结构。在神经科学研究发展的早期,由于脑图谱缺乏神经元水平的分辨率,无法区分神经元种类也无法验证突触连接的实际存在或区分直接与间接连接。但是随着遗传学标记方法和显微成像技术的发展,利用光学成像进行脑连接图谱绘制的特异性和分辨率迅速提升。标记和成像技术的迅速发展和数据的快速积累对于数据采集、存储和分析的软硬件提出了更高的要求,尤其是对神经元形态的识别和重构。The drawing of brain connection maps is of great significance for in-depth understanding of brain functions, simulating brain neural networks, and developing brain-like artificial intelligence. As the basic unit of neural networks, neurons can be divided into many types based on their morphology, development, connections, functions, and gene expression. Neural circuits formed by the interconnections between different types of neurons are the technical structures that carry various brain functions. In the early days of the development of neuroscience research, because brain maps lacked neuron-level resolution, it was impossible to distinguish neuron types, verify the actual existence of synaptic connections, or distinguish direct from indirect connections. However, with the development of genetic labeling methods and microscopic imaging technology, the specificity and resolution of brain connection mapping using optical imaging have rapidly improved. The rapid development of labeling and imaging technology and the rapid accumulation of data have put forward higher requirements for the software and hardware of data acquisition, storage and analysis, especially the identification and reconstruction of neuron morphology.

现有的一些辅助手动重构的商业或开源软件(例如Neurolucida,NeuroStudio,Simple Neurite Tracer,neuTube,Virtual Finger等)能提供自动重构的一些基本算法,但是在全脑尺度、细胞分辨率水平的重构时准确率不足,需要对重构结果进行手动修正,并且也无法支持TB量级的大数据处理。对于神经元胞体的自动识别目前尚无较好的成型软件,因此主要依赖于软件辅助的人工手动操作。Some existing commercial or open source software that assists manual reconstruction (such as Neurolucida, NeuroStudio, Simple Neurite Tracer, neuTube, Virtual Finger, etc.) can provide some basic algorithms for automatic reconstruction, but at the whole-brain scale and cell resolution level The accuracy during reconstruction is insufficient, requiring manual correction of the reconstruction results, and it cannot support terabyte-scale big data processing. There is currently no good software for the automatic identification of neuron cell bodies, so it mainly relies on software-assisted manual operations.

近年来,基于类脑神经网络的深度学习算法在图像图例方面取得了重大的突破,并开始被应用于神经元的重构和识别。但是目前这些算法在神经元的应用仅限于针对特定脑区或者特定功能的实现上,例如专门针对形变的脑图像和脑图谱配准的方法(专利公开号CN103268605A,CN106920228A)或者三维重建脑图谱的数据集校准(专利公开号CN108564607A),并没有形成一套完整的脑图谱绘制辅助软件。In recent years, deep learning algorithms based on brain-like neural networks have made major breakthroughs in image legends and have begun to be applied to the reconstruction and identification of neurons. However, the current application of these algorithms in neurons is limited to the realization of specific brain areas or specific functions, such as methods specifically for registration of deformed brain images and brain atlases (Patent Publication No. CN103268605A, CN106920228A) or three-dimensional reconstruction of brain atlases. Data set calibration (Patent Publication No. CN108564607A) does not form a complete set of brain mapping auxiliary software.

发明内容Contents of the invention

本发明的目的是提供一种基于计算机视觉的小鼠脑图谱绘制辅助系统及方法。此系统解决现有软件准确率不足和深度学习算法应用不全面的问题,针对小鼠脑图谱绘制的特殊需求,借助于计算机视觉算法进行大数量级图像的分解以及自动图像特征的提取和检测,实现小鼠脑图谱绘制辅助系统可视化、可交互以及自动和半自动化操作的功能。The purpose of the present invention is to provide a mouse brain atlas drawing assistance system and method based on computer vision. This system solves the problems of insufficient accuracy of existing software and incomplete application of deep learning algorithms. Aiming at the special needs of mouse brain mapping, it uses computer vision algorithms to decompose large-scale images and automatically extract and detect image features. Mouse brain mapping aids system visualization, interactivity, and automatic and semi-automatic operation.

为达到上述目的,本发明提供了一种基于计算机视觉的小鼠脑图谱绘制辅助系统,该系统包括预处理模块、检测模块、配准模块、识别分区模块和映射模块。预处理模块,对鼠脑显微图像进行预处理;检测模块,输入端与预处理模块的第一输出端连接,基于计算机视觉算法检测出鼠脑显微图像中的神经元胞体;配准模块,输入端与预处理模块的第二输出端连接,将预处理后的鼠脑显微图像与标准脑图谱进行配准比对,获得鼠脑显微图像特征;识别分区模块,输入端与配准模块的输出端连接,自动识别标准脑图谱中的分区,并根据鼠脑显微图像特征对鼠脑显微图像进行分区,获得鼠脑显微图像分区;映射模块,第一输入端与检测模块的输出端连接,第二输入端与识别分区模块的输出端连接,将神经元胞体与鼠脑显微图像分区进行一一映射,获得鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。In order to achieve the above objectives, the present invention provides a mouse brain atlas drawing assistance system based on computer vision. The system includes a preprocessing module, a detection module, a registration module, an identification partition module and a mapping module. The preprocessing module preprocesses the mouse brain microscopic image; the detection module, the input end is connected to the first output end of the preprocessing module, detects the neuron cell bodies in the mouse brain microscopic image based on the computer vision algorithm; the registration module , the input end is connected to the second output end of the preprocessing module, and the preprocessed mouse brain microscopic image is registered and compared with the standard brain atlas to obtain the characteristics of the mouse brain microscopic image; the input end of the identification partition module is connected to the preprocessing module. The output terminal of the quasi-module is connected to automatically identify the partitions in the standard brain atlas, and partition the mouse brain microscopic image according to the characteristics of the mouse brain microscopic image to obtain the mouse brain microscopic image partitions; the mapping module, the first input terminal is connected to the detection The output end of the module is connected, and the second input end is connected to the output end of the identification partition module. The neuron cell body and the mouse brain microscopic image partition are mapped one by one to obtain the partition information of the mouse brain microscopic image partition, and complete the mouse brain Assisted drawing of maps.

本发明还提供了一种基于计算机视觉的小鼠脑图谱绘制辅助方法,该方法是基于一种基于计算机视觉的小鼠脑图谱绘制辅助系统实现的,包括以下步骤:The invention also provides a computer vision-based mouse brain atlas drawing auxiliary method. The method is implemented based on a computer vision-based mouse brain atlas drawing auxiliary system and includes the following steps:

步骤1:将鼠脑显微图像传输至预处理模块,进行预处理获得预处理后的鼠脑显微图像,并将预处理后的鼠脑显微图像分为两路传输;Step 1: Transmit the mouse brain microscopic image to the preprocessing module, perform preprocessing to obtain the preprocessed mouse brain microscopic image, and divide the preprocessed mouse brain microscopic image into two channels for transmission;

步骤2:将第一路预处理后的鼠脑显微图像传输至检测模块,基于计算机视觉算法检测出预处理后的鼠脑显微图像中的神经元胞体;Step 2: Transmit the first preprocessed mouse brain microscopic image to the detection module, and detect the neuron cell bodies in the preprocessed mouse brain microscopic image based on the computer vision algorithm;

步骤3:将第二路预处理后的鼠脑显微图像传输至配准模块,与标准脑图谱中进行配准比对,获得鼠脑显微图像特征;Step 3: Transmit the second preprocessed mouse brain microscopic image to the registration module, and perform registration comparison with the standard brain atlas to obtain the mouse brain microscopic image characteristics;

步骤4:将鼠脑显微图像特征传输至识别分区模块,识别分区模块自动识别标准脑图谱中的分区,并根据鼠脑显微图像特征和标准脑图谱中的分区对鼠脑显微图像进行分区,获得鼠脑显微图像分区;Step 4: Transmit the characteristics of the mouse brain microscopic image to the identification partition module. The identification partition module automatically identifies the partitions in the standard brain atlas, and analyzes the mouse brain microscopic image according to the characteristics of the mouse brain microscopic image and the partitions in the standard brain atlas. Partition, obtain the mouse brain microscopic image partition;

步骤5:将神经元胞体和鼠脑显微图像分区一同传输至映射模块完成映射,获得鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。Step 5: Transfer the neuron cell bodies and the mouse brain microscopic image partitions to the mapping module to complete the mapping, obtain the partition information of the mouse brain microscopic image partitions, and complete the auxiliary drawing of the mouse brain atlas.

最优选的,预处理还包括以下步骤:Most preferably, pretreatment also includes the following steps:

步骤1.1:从鼠脑显微图像中提取图片序列,并基于图片序列进行轮廓Hu矩计算,获得轮廓标准;Step 1.1: Extract the picture sequence from the mouse brain microscopic image, and calculate the contour Hu moment based on the picture sequence to obtain the contour standard;

步骤1.2:根据轮廓标准对鼠脑显微图像进行轮廓匹配和调整,获得预处理后的鼠脑显微图像。Step 1.2: Contour matching and adjustment of the mouse brain microscopic image according to the contour standard to obtain the preprocessed mouse brain microscopic image.

最优选的,检测还包括以下步骤:Most preferably, the test also includes the following steps:

步骤2.1:人工对预处理后的鼠脑显微图像中数量有限的神经元胞体进行标注,并将预处理后的鼠脑显微图像裁剪为若干个像素相同的鼠脑切片显微图像;Step 2.1: Manually label a limited number of neuron cell bodies in the preprocessed mouse brain microscopic image, and crop the preprocessed mouse brain microscopic image into several mouse brain slice microscopic images with the same pixels;

步骤2.2:通过COCO数据集对多层卷积神经网络进行预训练,并根据标注的神经元胞体对预训练后的多层卷积神经网络进行微调,生成检测神经网络;Step 2.2: Pre-train the multi-layer convolutional neural network through the COCO data set, and fine-tune the pre-trained multi-layer convolutional neural network based on the labeled neuron cell bodies to generate a detection neural network;

步骤2.3:将鼠脑切片显微图像传输至检测神经网络,基于计算机视觉算法检测鼠脑切片显微图像中的神经元胞体;Step 2.3: Transmit the microscopic image of the mouse brain slice to the detection neural network, and detect the neuron cell bodies in the microscopic image of the mouse brain slice based on the computer vision algorithm;

步骤2.4:根据鼠脑切片显微图像中的神经元胞体预测出预处理后的鼠脑显微图像中的神经元胞体。Step 2.4: Predict the neuron cell bodies in the preprocessed mouse brain microscopic image based on the neuron cell bodies in the mouse brain slice microscopic image.

最优选的,检测鼠脑切片显微图像中的神经元胞体还包括以下步骤:Most preferably, detecting neuron cell bodies in microscopic images of rat brain slices also includes the following steps:

步骤2.3.1:定位鼠脑切片显微图像中神经元胞体的中心点及其大小作为尺寸标准;Step 2.3.1: Locate the center point of the neuron cell body in the microscopic image of the mouse brain slice and its size as the size standard;

步骤2.3.2:根据尺寸标准基于计算机视觉中的目标检测算法输入检测神经网络进行预测,获得置信热力图;Step 2.3.2: According to the size standard, input the detection neural network based on the target detection algorithm in computer vision for prediction, and obtain the confidence heat map;

步骤2.3.3:通过两个回归算法支路对置信热力图进行计算,计算出鼠脑切片显微图像中的神经元胞体。Step 2.3.3: Calculate the confidence heat map through two regression algorithm branches, and calculate the neuron cell bodies in the microscopic image of the mouse brain slice.

最优选的,检测为自动/半自动调整,分别通过检测模块/人工完成所述神经元胞体的自动/半自动检测。Most preferably, the detection is an automatic/semi-automatic adjustment, and the automatic/semi-automatic detection of the neuron cell bodies is completed through the detection module/manually respectively.

最优选的,配准比对是将预处理后的鼠脑显微图像中的特征与标准脑图谱中的特征一一比对,获得预处理后的鼠脑显微图像中与标准脑图谱中的特征一一对应的鼠脑显微图像特征。Most preferably, the registration comparison is to compare the features in the preprocessed mouse brain microscopic image with the features in the standard brain atlas one by one to obtain the difference between the preprocessed mouse brain microscopic image and the standard brain atlas. The features correspond one-to-one to the microscopic image features of the mouse brain.

最优选的,一一比对是通过网格变形微调算法根据标准脑图谱中的特征将预处理后的鼠脑显微图像中的特征进行微调,使得预处理后的鼠脑显微图像中的特征与标准脑图谱中的特征相对应。Most preferably, the one-to-one comparison is to use a grid deformation fine-tuning algorithm to fine-tune the features in the pre-processed mouse brain microscopic image according to the features in the standard brain atlas, so that the pre-processed mouse brain microscopic image has Features correspond to features in standard brain atlases.

最优选的,配准比对是通过鼠脑显微图像分区的尺寸与标准脑图谱的分辨率的精确度水平上的基础交互操作。Most preferably, the registration comparison is based on the interaction of the size of the mouse brain microscopic image partitions with the accuracy level of the resolution of the standard brain atlas.

最优选的,绘制的小鼠脑图谱为三维鼠脑图谱模型;根据鼠脑显微图像分区完成小鼠脑图谱的辅助绘制是通过三维模型中以任意角度完成的。Most preferably, the drawn mouse brain atlas is a three-dimensional mouse brain atlas model; the auxiliary drawing of the mouse brain atlas based on the mouse brain microscopic image partition is completed at any angle in the three-dimensional model.

运用此发明,解决了现有软件准确率不足和深度学习算法应用不全面的问题,针对小鼠脑图谱绘制的特殊需求,借助于计算机视觉算法进行大数量级图像的分解以及自动图像特征的提取和检测,实现了小鼠脑图谱绘制辅助系统可视化、可交互以及自动和半自动化操作的功能。The use of this invention solves the problems of insufficient accuracy of existing software and incomplete application of deep learning algorithms. In response to the special needs of mouse brain atlas drawing, computer vision algorithms are used to decompose large-scale images and automatically extract and extract image features. Detection, realizing the functions of visual, interactive, automatic and semi-automatic operation of the mouse brain atlas drawing assistance system.

相对于现有技术,本发明具有以下有益效果:Compared with the existing technology, the present invention has the following beneficial effects:

1、本发明提供的小鼠脑图谱绘制辅助系统解决了现有软件准确率不足和深度学习算法应用不全面的问题。1. The mouse brain atlas drawing assistance system provided by the present invention solves the problems of insufficient accuracy of existing software and incomplete application of deep learning algorithms.

2、本发明提供的小鼠脑图谱绘制辅助系统是建立在脑神经研究人员专家知识的基础上,通过计算机视觉算法进行大数量级图像的分解以及自动图像特征的提取和检测,实现了小鼠脑图谱绘制辅助系统的自动以及半自动操作,减轻了研究人员在脑图谱绘制上的冗余枯燥的人工负担,提供了有效辅助功能。2. The mouse brain atlas drawing auxiliary system provided by the present invention is based on the expert knowledge of cranial nerve researchers. It uses computer vision algorithms to decompose large-scale images and extract and detect automatic image features, realizing mouse brain mapping. The automatic and semi-automatic operation of the map drawing assistance system reduces the redundant and boring manual burden of researchers in brain map drawing and provides effective auxiliary functions.

3、本发明提供的小鼠脑图谱绘制辅助系统实现了小鼠脑图谱绘制辅助系统可视化、可交互的功能。3. The mouse brain atlas drawing auxiliary system provided by the present invention realizes the visual and interactive functions of the mouse brain atlas drawing auxiliary system.

附图说明Description of the drawings

图1为本发明提供的小鼠脑图谱绘制辅助系统中各模块结构示意图;Figure 1 is a schematic structural diagram of each module in the mouse brain atlas drawing assistance system provided by the present invention;

图2为本发明提供的小鼠脑图谱绘制辅助方法流程示意图;Figure 2 is a schematic flow chart of the mouse brain atlas drawing auxiliary method provided by the present invention;

图3为本发明提供的小鼠脑谱图进行预处理的流程示意图;Figure 3 is a schematic flow chart of preprocessing the mouse brain spectrum provided by the present invention;

图4为本发明提供的鼠脑显微图像检测的流程示意图;Figure 4 is a schematic flow chart of mouse brain microscopic image detection provided by the present invention;

图5为本发明提供的鼠脑切片显微图像检测的流程示意图。Figure 5 is a schematic flow chart of the microscopic image detection of mouse brain slices provided by the present invention.

具体实施方式Detailed ways

以下结合附图通过具体实施例对本发明作进一步的描述,这些实施例仅用于说明本发明,并不是对本发明保护范围的限制。The present invention will be further described below through specific embodiments in conjunction with the accompanying drawings. These embodiments are only used to illustrate the present invention and are not intended to limit the scope of protection of the present invention.

本发明是一种基于计算机视觉的小鼠脑图谱绘制辅助系统,是通过机器学习的方法以及专家知识的辅助实现的可视化、可交互的软件系统。The invention is a mouse brain atlas drawing assistance system based on computer vision. It is a visual and interactive software system implemented through the assistance of machine learning methods and expert knowledge.

如图1所示,该系统包括预处理模块、检测模块、配准模块、识别分区模块和映射模块。预处理模块,对鼠脑显微图像进行预处理;检测模块,输入端与预处理模块的第一输出端连接,基于计算机视觉算法检测出鼠脑显微图像中的神经元胞体;配准模块,输入端与预处理模块的第二输出端连接,将预处理后的鼠脑显微图像与标准脑图谱进行配准比对,获得鼠脑显微图像特征;识别分区模块,输入端与配准模块的输出端连接,自动识别标准脑图谱中的分区,并根据所述鼠脑显微图像特征对所述鼠脑显微图像进行分区,获得鼠脑显微图像分区;映射模块,第一输入端与检测模块的输出端连接,第二输入端与识别分区模块的输出端连接,,将神经元胞体与鼠脑显微图像分区进行一一映射,获得鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。As shown in Figure 1, the system includes a preprocessing module, a detection module, a registration module, an identification partition module and a mapping module. The preprocessing module preprocesses the mouse brain microscopic image; the detection module, the input end is connected to the first output end of the preprocessing module, detects the neuron cell bodies in the mouse brain microscopic image based on the computer vision algorithm; the registration module , the input end is connected to the second output end of the preprocessing module, and the preprocessed mouse brain microscopic image is registered and compared with the standard brain atlas to obtain the characteristics of the mouse brain microscopic image; the input end of the identification partition module is connected to the preprocessing module. The output end of the quasi-module is connected to automatically identify the partitions in the standard brain atlas, and partition the mouse brain microscopic image according to the characteristics of the mouse brain microscopic image to obtain the mouse brain microscopic image partitions; the mapping module, the first The input end is connected to the output end of the detection module, and the second input end is connected to the output end of the identification partition module. The neuron cell body and the mouse brain microscopic image partition are mapped one by one to obtain the partition information of the mouse brain microscopic image partition. , to complete the auxiliary drawing of mouse brain atlas.

该系统具有四项基本功能;所述四项基本功能包括配准功能、自动识别分区功能、检测功能和三维建模功能;该四项基本功能能够辅助研究人员进行脑图谱绘制,减轻全脑尺寸脑图谱绘制的人工复杂度,也可以根据需要仅提供所关注特定脑区的图谱辅助信息。The system has four basic functions; the four basic functions include registration function, automatic identification partition function, detection function and three-dimensional modeling function; these four basic functions can assist researchers in brain mapping and reduce the size of the whole brain The manual complexity of brain mapping can also provide only map auxiliary information for specific brain areas of concern as needed.

本发明还提出一种基于计算机视觉的小鼠脑图谱绘制辅助方法,该方法是基于一种基于计算机视觉的小鼠脑图谱绘制辅助系统实现的,如图2所示,包括以下步骤:The present invention also proposes a mouse brain atlas drawing auxiliary method based on computer vision. The method is implemented based on a mouse brain atlas drawing auxiliary system based on computer vision. As shown in Figure 2, it includes the following steps:

步骤1:将鼠脑显微图像传输至预处理模块进行预处理,获得预处理后的鼠脑显微图像,并将预处理后的鼠脑显微图像分为两路传输。Step 1: Transmit the mouse brain microscopic image to the preprocessing module for preprocessing, obtain the preprocessed mouse brain microscopic image, and divide the preprocessed mouse brain microscopic image into two channels for transmission.

所采集的鼠脑显微图像的本身构造以及成像技术上存在差异会造成小鼠脑谱图的扭曲和偏差,需要进行预处理为输入配准模块中与标准脑图谱进行配准计算做准备。如图3所示,预处理还包括以下步骤:Differences in the structure and imaging technology of the collected mouse brain microscopic images will cause distortion and deviation of the mouse brain atlas. Preprocessing is required to prepare for the registration calculation with the standard brain atlas in the input registration module. As shown in Figure 3, preprocessing also includes the following steps:

步骤1.1:从鼠脑显微图像中提取图片序列,并基于鼠脑显微图像中的图片序列进行轮廓图像矩(Hu矩)计算,获得轮廓标准;Step 1.1: Extract the picture sequence from the mouse brain microscopic image, and calculate the contour image moment (Hu moment) based on the picture sequence in the mouse brain microscopic image to obtain the contour standard;

步骤1.2:根据轮廓标准对鼠脑显微图像进行轮廓匹配和调整,选取预处理后的鼠脑显微图像。Step 1.2: Perform contour matching and adjustment on the mouse brain microscopic image according to the contour standard, and select the preprocessed mouse brain microscopic image.

步骤2:将第一路预处理后的鼠脑显微图像传输至检测模块,基于计算机视觉算法检测出所述预处理后的鼠脑显微图像中的神经元胞体;如图4所示,检测还包括以下步骤:Step 2: Transmit the first preprocessed mouse brain microscopic image to the detection module, and detect the neuron cell bodies in the preprocessed mouse brain microscopic image based on the computer vision algorithm; as shown in Figure 4, Testing also includes the following steps:

步骤2.1:人工对预处理后的鼠脑显微图像中数量有限的神经元胞体进行标注,并将所述预处理后的鼠脑显微图像裁剪为若干个像素相同的鼠脑切片显微图像;Step 2.1: Manually label a limited number of neuron cell bodies in the preprocessed mouse brain microscopic image, and crop the preprocessed mouse brain microscopic image into several mouse brain slice microscopic images with the same pixels ;

步骤2.2:通过微软常用目标数据集(MicroSoft Common Objects inContext,COCO数据集)对多层卷积神经网络层进行预训练,并根据标注的鼠脑显微图像中神经元胞体对多层卷积神经网络层进行微调,生成检测神经网络,使得检测神经网络在少量数据集的情况下有针对鼠脑显微图像中神经元胞体比较高的识别准确率。Step 2.2: Pre-train the multi-layer convolutional neural network layer through the Microsoft Common Objects inContext (COCO data set), and perform multi-layer convolutional neural network training based on the neuron cell bodies in the labeled mouse brain microscopic images. The network layer is fine-tuned to generate a detection neural network, so that the detection neural network has a relatively high recognition accuracy for neuron cell bodies in mouse brain microscopic images with a small amount of data sets.

步骤2.3:将鼠脑切片显微图像传输至检测神经网络,基于计算机视觉算法检测鼠脑切片显微图像中的神经元胞体;检测鼠脑切片显微图像中的神经元胞体还包括以下步骤:Step 2.3: Transmit the microscopic image of the mouse brain slice to the detection neural network, and detect the neuron cell bodies in the microscopic image of the mouse brain slice based on the computer vision algorithm; detecting the neuron cell bodies in the microscopic image of the mouse brain slice also includes the following steps:

步骤2.3.1:鼠脑显微图像的尺寸大,检测所需识别的鼠脑显微图像中神经元胞体数量多且在鼠脑显微图像中面积小,将鼠脑显微图像裁剪为若干个像素相同的鼠脑切片显微图像,来提升鼠脑显微图像中神经元胞体检测的准确率;并取其中任意一张鼠脑切片显微图像,定位鼠脑切片显微图像中神经元胞体的中心点及其大小作为尺寸标准;Step 2.3.1: The size of the mouse brain microscopic image is large. The number of neuron cell bodies in the mouse brain microscopic image to be identified for detection is large and the area in the mouse brain microscopic image is small. Crop the mouse brain microscopic image into several mouse brain slice microscopic images with the same pixels to improve the accuracy of neuron cell body detection in the mouse brain slice microscopic image; and take any one of the mouse brain slice microscopic images to locate the neurons in the mouse brain slice microscopic image The center point of the cell body and its size serve as size standards;

步骤2.3.2:根据尺寸标准基于计算机视觉中的目标检测算法输入检测神经网络进行预测,获得置信热力图;Step 2.3.2: According to the size standard, input the detection neural network into the detection neural network for prediction based on the target detection algorithm in computer vision, and obtain the confidence heat map;

步骤2.3.3:通过两个回归算法支路对置信热力图进行计算,计算出鼠脑切片显微图像中的神经元胞体。Step 2.3.3: Calculate the confidence heat map through two regression algorithm branches, and calculate the neuron cell bodies in the microscopic image of the mouse brain slice.

步骤2.4:根据鼠脑切片显微图像中的神经元胞体预测出预处理后的鼠脑显微图像中的神经元胞体。Step 2.4: Predict the neuron cell bodies in the preprocessed mouse brain microscopic image based on the neuron cell bodies in the mouse brain slice microscopic image.

预测预处理后的鼠脑显微图像中的神经元胞体是根据鼠脑切片显微图像中神经元胞体的尺寸计算出的。Predicting the neuronal cell bodies in the preprocessed rat brain microscopic images is calculated based on the size of the neuronal cell bodies in the rat brain slice microscopic images.

检测为自动/半自动调整,分别通过检测模块/人工完成预处理后的鼠脑显微图像中的神经元胞体的自动/半自动检测。The detection is automatically/semi-automatically adjusted, and the automatic/semi-automatic detection of neuron cell bodies in the preprocessed mouse brain microscopic images is completed through the detection module/manually respectively.

步骤3:为了实现鼠脑显微图像中的神经元胞体的功能识别和跟踪功能,需要先明确鼠脑显微图像中的神经元胞体所属的小鼠脑图谱的分区,所以将第二路预处理后的鼠脑显微图像传输至配准模块,与标准脑图谱中进行配准比对,获得鼠脑显微图像特征。Step 3: In order to realize the functional identification and tracking function of neuron cell bodies in the mouse brain microscopic image, it is necessary to first clarify the partition of the mouse brain atlas to which the neuron cell bodies in the mouse brain microscopic image belong, so the second path is preset. The processed mouse brain microscopic image is transmitted to the registration module and compared with the standard brain atlas to obtain the mouse brain microscopic image characteristics.

步骤4:将鼠脑显微图像特征传输至识别分区模块,识别分区模块自动识别标准脑图谱中的分区,并根据鼠脑显微图像特征和标准脑图谱中的分区对鼠脑显微图像进行分区,获得鼠脑显微图像分区。Step 4: Transmit the characteristics of the mouse brain microscopic image to the identification partition module. The identification partition module automatically identifies the partitions in the standard brain atlas, and analyzes the mouse brain microscopic image according to the characteristics of the mouse brain microscopic image and the partitions in the standard brain atlas. Partitioning, obtaining the partitions of mouse brain microscopic images.

配准比对是将预处理后的鼠脑显微图像中的特征与标准脑图谱中的特征一一比对,获得预处理后的鼠脑显微图像中与标准脑图谱中的特征一一对应的鼠脑显微图像特征。Registration comparison is to compare the features in the preprocessed mouse brain microscopic image with the features in the standard brain atlas one by one, and obtain the features in the preprocessed mouse brain microscopic image and the standard brain atlas one by one. Corresponding microscopic image features of mouse brain.

其中,一一比对是通过网格变形微调算法根据标准脑图谱中的特征将预处理后的鼠脑显微图像中的特征进行微调,使得预处理后的鼠脑显微图像中的特征与标准脑图谱中的特征相对应。Among them, the one-to-one comparison uses a grid deformation fine-tuning algorithm to fine-tune the features in the pre-processed mouse brain microscopic image according to the features in the standard brain atlas, so that the features in the pre-processed mouse brain microscopic image are consistent with the features in the standard brain atlas. Corresponds to features in standard brain atlases.

配准计算采用了机器学习的算法,并且根据脑图谱绘制的不同复杂度需求,在面对大数据量级别的鼠脑图像时,综合考虑算法精确度和运行效率,采用不同的算法模型。The registration calculation uses a machine learning algorithm, and according to the different complexity requirements of brain atlas drawing, different algorithm models are adopted based on the comprehensive consideration of algorithm accuracy and operating efficiency when facing large-scale mouse brain images.

配准比对是通过鼠脑显微图像分区的尺寸与标准脑图谱的分辨率的精确度水平上的基础交互操作。对标准脑图谱的操作是在标准脑图谱分辨率的精确度下进行,对鼠脑显微图像的操作是在鼠脑显微图像的分辨率下进行的,两者通过配准模块的图像配准进行关联,且该配准过程中不损失标准脑图谱和鼠脑显微图像的精确度。Registration comparison is a fundamental interaction between the size of the mouse brain microscopic image partitions and the accuracy level of the resolution of the standard brain atlas. The operation on the standard brain atlas is performed at the accuracy of the resolution of the standard brain atlas, and the operation on the mouse brain microscopic image is performed at the resolution of the mouse brain microscopic image. The two are matched through the image registration module. The accuracy of the standard brain atlas and mouse brain microscopic images is not lost in the registration process.

步骤5:将鼠脑显微图像中的神经元胞体和鼠脑显微图像分区传输至映射模块完成映射,获得鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。Step 5: Transfer the neuron cell bodies and mouse brain microscopic image partitions in the mouse brain microscopic image to the mapping module to complete the mapping, obtain the partition information of the mouse brain microscopic image partition, and complete the auxiliary drawing of the mouse brain atlas.

绘制的小鼠脑图谱为三维鼠脑图谱模型;根据鼠脑显微图像分区完成小鼠脑图谱的辅助绘制是通过三维模型中以任意角度完成的,能够扩大标准脑图谱的视角范围,模拟鼠脑显微图像在检测过程中造成的角度扭曲。The drawn mouse brain atlas is a three-dimensional mouse brain atlas model; the auxiliary drawing of the mouse brain atlas based on the mouse brain microscopic image partition is completed at any angle in the three-dimensional model, which can expand the viewing angle range of the standard brain atlas and simulate the mouse brain atlas. Angle distortion caused by brain microscopic images during detection.

本发明的工作原理:Working principle of the invention:

将鼠脑显微图像传输至预处理模块,进行预处理获得预处理后的鼠脑显微图像,并将预处理后的鼠脑显微图像分为两路传输;将第一路预处理后的鼠脑显微图像传输至检测模块,基于计算机视觉算法检测出预处理后的鼠脑显微图像中的神经元胞体;将第二路预处理后的鼠脑显微图像传输至配准模块,与标准脑图谱中进行配准比对,获得鼠脑显微图像特征;将鼠脑显微图像特征传输至识别分区模块,识别分区模块自动识别标准脑图谱中的分区,并根据鼠脑显微图像特征和标准脑图谱中的分区对鼠脑显微图像进行分区,获得鼠脑显微图像分区;将神经元胞体和鼠脑显微图像分区一同传输至映射模块完成映射,获得鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。Transmit the mouse brain microscopic image to the preprocessing module, perform preprocessing to obtain the preprocessed mouse brain microscopic image, and divide the preprocessed mouse brain microscopic image into two channels for transmission; The mouse brain microscopic image is transmitted to the detection module, and the neuron cell body in the preprocessed mouse brain microscopic image is detected based on the computer vision algorithm; the second preprocessed mouse brain microscopic image is transmitted to the registration module , register and compare with the standard brain atlas to obtain the mouse brain microscopic image features; transfer the mouse brain microscopic image features to the recognition partition module, and the recognition partition module automatically identifies the partitions in the standard brain atlas, and based on the mouse brain display The microimage features and the partitions in the standard brain atlas are used to partition the mouse brain microscopic image to obtain the mouse brain microscopic image partitions; the neuron cell body and the mouse brain microscopic image partitions are transmitted to the mapping module to complete the mapping, and the mouse brain microscopic image partitions are obtained. The partition information of the micro-image partition completes the auxiliary drawing of the mouse brain atlas.

综上所述,本发明一种基于计算机视觉的小鼠脑图谱绘制辅助系统及方法,解决了现有软件准确率不足和深度学习算法应用不全面的问题,针对小鼠脑图谱绘制的特殊需求,借助于计算机视觉算法进行大数量级图像的分解以及自动图像特征的提取和检测,实现了小鼠脑图谱绘制辅助系统可视化、可交互以及自动和半自动化操作的功能。In summary, the present invention is a computer vision-based mouse brain atlas drawing auxiliary system and method, which solves the problems of insufficient accuracy of existing software and incomplete application of deep learning algorithms, and addresses the special needs of mouse brain atlas drawing. , with the help of computer vision algorithms for decomposition of large-scale images and automatic extraction and detection of image features, the mouse brain atlas drawing assistance system has the functions of visualization, interactivity, automatic and semi-automatic operation.

尽管本发明的内容已经通过上述优选实施例作了详细介绍,但应当认识到上述的描述不应被认为是对本发明的限制。在本领域技术人员阅读了上述内容后,对于本发明的多种修改和替代都将是显而易见的。因此,本发明的保护范围应由所附的权利要求来限定。Although the content of the present invention has been described in detail through the above preferred embodiments, it should be understood that the above description should not be considered as limiting the present invention. Various modifications and substitutions to the present invention will be apparent to those skilled in the art after reading the above. Therefore, the protection scope of the present invention should be defined by the appended claims.

Claims (8)

1.一种基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,该方法是基于一种基于计算机视觉的小鼠脑图谱绘制辅助系统实现的,所述的基于计算机视觉的小鼠脑图谱绘制辅助系统包括:预处理模块,对鼠脑显微图像进行预处理;检测模块,输入端与所述预处理模块的第一输出端连接,基于计算机视觉算法检测出鼠脑显微图像中的神经元胞体;配准模块,输入端与所述预处理模块的第二输出端连接,将预处理后的鼠脑显微图像与标准脑图谱进行配准比对,获得鼠脑显微图像特征;识别分区模块,输入端与所述配准模块的输出端连接,自动识别所述标准脑图谱中的分区,并根据所述鼠脑显微图像特征对所述鼠脑显微图像进行分区,获得鼠脑显微图像分区;映射模块,第一输入端与所述检测模块的输出端连接,第二输入端与所述识别分区模块的输出端连接,将所述神经元胞体与所述鼠脑显微图像分区进行一一映射,获得所述鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制;1. A computer vision-based mouse brain atlas drawing auxiliary method, characterized in that the method is based on a computer vision-based mouse brain atlas drawing auxiliary system, and the computer vision-based mouse brain atlas drawing auxiliary system is implemented. The map drawing auxiliary system includes: a preprocessing module, which preprocesses the mouse brain microscopic image; a detection module, whose input end is connected to the first output end of the preprocessing module, and which detects the defects in the mouse brain microscopic image based on a computer vision algorithm. The neuron cell body; the registration module, the input end is connected to the second output end of the preprocessing module, and the preprocessed mouse brain microscopic image is registered and compared with the standard brain atlas to obtain the mouse brain microscopic image Features; identifying partition module, the input end is connected to the output end of the registration module, automatically identifies the partitions in the standard brain atlas, and partitions the mouse brain microscopic image according to the characteristics of the mouse brain microscopic image , obtain the mouse brain microscopic image partition; the mapping module, the first input end is connected to the output end of the detection module, the second input end is connected to the output end of the identification partition module, and the neuron cell body is connected to the output end of the detection module. The mouse brain microscopic image partitions are mapped one by one to obtain the partition information of the mouse brain microscopic image partitions, and complete the auxiliary drawing of the mouse brain atlas; 所述基于计算机视觉的小鼠脑图谱绘制辅助方法包括以下步骤:The computer vision-based mouse brain mapping auxiliary method includes the following steps: 步骤1:将鼠脑显微图像传输至所述预处理模块,进行预处理获得预处理后的鼠脑显微图像,并将所述预处理后的鼠脑显微图像分为两路传输;Step 1: Transmit the mouse brain microscopic image to the preprocessing module, perform preprocessing to obtain the preprocessed mouse brain microscopic image, and divide the preprocessed mouse brain microscopic image into two channels for transmission; 步骤2:将第一路预处理后的鼠脑显微图像传输至所述检测模块,基于计算机视觉算法检测出所述预处理后的鼠脑显微图像中的神经元胞体;Step 2: Transmit the first preprocessed mouse brain microscopic image to the detection module, and detect the neuron cell bodies in the preprocessed mouse brain microscopic image based on a computer vision algorithm; 包括以下步骤:Includes the following steps: 步骤2.1:人工对所述预处理后的鼠脑显微图像中数量有限的神经元胞体进行标注,并将所述预处理后的鼠脑显微图像裁剪为若干个像素相同的鼠脑切片显微图像;Step 2.1: Manually label a limited number of neuron cell bodies in the preprocessed mouse brain microscopic image, and crop the preprocessed mouse brain microscopic image into several mouse brain slice displays with the same pixels. microimage; 步骤2.2:通过COCO数据集对多层卷积神经网络进行预训练,并根据标注的神经元胞体对预训练后的多层卷积神经网络进行微调,生成检测神经网络;Step 2.2: Pre-train the multi-layer convolutional neural network through the COCO data set, and fine-tune the pre-trained multi-layer convolutional neural network based on the labeled neuron cell bodies to generate a detection neural network; 步骤2.3:将所述鼠脑切片显微图像传输至所述检测神经网络,基于计算机视觉算法检测所述鼠脑切片显微图像中的神经元胞体;所述检测所述鼠脑切片显微图像中的神经元胞体还包括以下步骤:Step 2.3: Transmit the microscopic image of the mouse brain slice to the detection neural network, and detect the neuron cell bodies in the microscopic image of the mouse brain slice based on a computer vision algorithm; detecting the microscopic image of the mouse brain slice The neuron cell body in also includes the following steps: 步骤2.3.1:定位所述鼠脑切片显微图像中神经元胞体的中心点及其大小作为尺寸标准;Step 2.3.1: Locate the center point of the neuron cell body in the microscopic image of the mouse brain slice and its size as the size standard; 步骤2.3.2:根据所述尺寸标准基于计算机视觉中的目标检测算法输入所述检测神经网络进行预测,获得置信热力图;Step 2.3.2: According to the size standard, input the detection neural network based on the target detection algorithm in computer vision for prediction, and obtain a confidence heat map; 步骤2.3.3:通过两个回归算法支路对所述置信热力图进行计算,计算出所述鼠脑切片显微图像中的神经元胞体Step 2.3.3: Calculate the confidence heat map through two regression algorithm branches, and calculate the neuron cell bodies in the mouse brain slice microscopic image 步骤2.4:根据所述鼠脑切片显微图像中的神经元胞体预测出所述预处理后的鼠脑显微图像中的神经元胞体;Step 2.4: Predict the neuron cell bodies in the preprocessed rat brain microscopic image based on the neuron cell bodies in the rat brain slice microscopic image; 步骤3:将第二路预处理后的鼠脑显微图像传输至所述配准模块,与标准脑图谱中进行配准比对,获得鼠脑显微图像特征;Step 3: Transmit the second preprocessed mouse brain microscopic image to the registration module, perform registration comparison with the standard brain atlas, and obtain the mouse brain microscopic image characteristics; 步骤4:将所述鼠脑显微图像特征传输至所述识别分区模块,所述识别分区模块自动识别所述标准脑图谱中的分区,并根据所述鼠脑显微图像特征和所述标准脑图谱中的分区对所述鼠脑显微图像进行分区,获得鼠脑显微图像分区;Step 4: Transmit the mouse brain microscopic image features to the identification partition module. The identification partition module automatically identifies the partitions in the standard brain atlas, and determines the partitions based on the mouse brain microscopic image features and the standard. The partitions in the brain atlas partition the mouse brain microscopic image to obtain the mouse brain microscopic image partitions; 步骤5:将所述神经元胞体和所述鼠脑显微图像分区一同传输至所述映射模块完成映射,获得所述鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。Step 5: Transfer the neuron cell bodies and the mouse brain microscopic image partitions to the mapping module to complete the mapping, obtain the partition information of the mouse brain microscopic image partitions, and complete the auxiliary drawing of the mouse brain atlas. 2.如权利要求1所述的基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,所述预处理还包括以下步骤:2. The mouse brain atlas drawing auxiliary method based on computer vision as claimed in claim 1, characterized in that the preprocessing further includes the following steps: 步骤1.1:从鼠脑显微图像中提取图片序列,并基于所述图片序列进行轮廓Hu矩计算,获得轮廓标准;Step 1.1: Extract a picture sequence from the mouse brain microscopic image, and calculate the contour Hu moment based on the picture sequence to obtain the contour standard; 步骤1.2:根据所述轮廓标准对所述鼠脑显微图像进行轮廓匹配和调整,获得所述预处理后的鼠脑显微图像。Step 1.2: Perform contour matching and adjustment on the mouse brain microscopic image according to the contour standard to obtain the preprocessed mouse brain microscopic image. 3.如权利要求2所述的基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,所述检测为自动/半自动调整,分别通过所述检测模块/人工完成所述神经元胞体的自动/半自动检测。3. The mouse brain atlas drawing auxiliary method based on computer vision as claimed in claim 2, characterized in that the detection is automatic/semi-automatic adjustment, and the automatic adjustment of the neuron cell body is completed by the detection module/manually respectively. /Semi-automatic detection. 4.如权利要求3所述的基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,所述配准比对是将所述预处理后的鼠脑显微图像中的特征与所述标准脑图谱中的特征一一比对,获得所述预处理后的鼠脑显微图像中与所述标准脑图谱中的特征一一对应的鼠脑显微图像特征。4. The mouse brain atlas drawing auxiliary method based on computer vision as claimed in claim 3, characterized in that the registration comparison is to compare the features in the preprocessed mouse brain microscopic image with the The features in the standard brain atlas are compared one by one to obtain the mouse brain microscopic image features in the preprocessed mouse brain microscopic image that correspond to the features in the standard brain atlas. 5.如权利要求4所述的基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,所述一一比对是通过网格变形微调算法根据所述标准脑图谱中的特征将所述预处理后的鼠脑显微图像中的特征进行微调,使得所述预处理后的鼠脑显微图像中的特征与所述标准脑图谱中的特征相对应。5. The mouse brain atlas drawing auxiliary method based on computer vision as claimed in claim 4, characterized in that the one-to-one comparison is based on the characteristics in the standard brain atlas through a grid deformation fine-tuning algorithm. The features in the preprocessed mouse brain microscopic image are fine-tuned so that the features in the preprocessed mouse brain microscopic image correspond to the features in the standard brain atlas. 6.如权利要求5所述的基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,所述配准比对是通过所述鼠脑显微图像分区的尺寸与所述标准脑图谱的分辨率的精确度水平上的基础交互操作。6. The mouse brain atlas drawing auxiliary method based on computer vision as claimed in claim 5, characterized in that the registration comparison is based on the size of the mouse brain microscopic image partition and the standard brain atlas. Basic interactive operations at a precise level of resolution. 7.如权利要求6所述的基于计算机视觉的小鼠脑图谱绘制辅助方法,其特征在于,绘制的所述小鼠脑图谱为三维鼠脑图谱模型;根据所述鼠脑显微图像分区完成小鼠脑图谱的辅助绘制是通过三维模型中以任意角度完成的。7. The mouse brain atlas drawing auxiliary method based on computer vision as claimed in claim 6, characterized in that the drawn mouse brain atlas is a three-dimensional mouse brain atlas model; it is completed according to the partitioning of the mouse brain microscopic image. The auxiliary drawing of the mouse brain atlas is completed at any angle in the three-dimensional model. 8.一种用于实现如权利要求1-7中任意一项所述的基于计算机视觉的小鼠脑图谱绘制辅助方法的基于计算机视觉的小鼠脑图谱绘制辅助系统,其特征在于,包括:8. A computer vision-based mouse brain atlas drawing auxiliary system for implementing the computer vision-based mouse brain atlas drawing auxiliary method according to any one of claims 1 to 7, characterized in that it includes: 预处理模块,对鼠脑显微图像进行预处理;Preprocessing module, preprocessing mouse brain microscopic images; 检测模块,输入端与所述预处理模块的第一输出端连接,基于计算机视觉算法检测出鼠脑显微图像中的神经元胞体;A detection module, whose input end is connected to the first output end of the preprocessing module, detects neuron cell bodies in the mouse brain microscopic image based on a computer vision algorithm; 配准模块,输入端与所述预处理模块的第二输出端连接,将预处理后的鼠脑显微图像与标准脑图谱进行配准比对,获得鼠脑显微图像特征;A registration module, whose input end is connected to the second output end of the preprocessing module, registers and compares the preprocessed mouse brain microscopic image with the standard brain atlas to obtain the mouse brain microscopic image characteristics; 识别分区模块,输入端与所述配准模块的输出端连接,自动识别所述标准脑图谱中的分区,并根据所述鼠脑显微图像特征对所述鼠脑显微图像进行分区,获得鼠脑显微图像分区;Identification partition module, the input end is connected to the output end of the registration module, automatically identifies the partitions in the standard brain atlas, and partitions the mouse brain microscopic image according to the characteristics of the mouse brain microscopic image, and obtains Mouse brain microscopic image partitions; 映射模块,第一输入端与所述检测模块的输出端连接,第二输入端与所述识别分区模块的输出端连接,将所述神经元胞体与所述鼠脑显微图像分区进行一一映射,获得所述鼠脑显微图像分区的分区信息,完成小鼠脑图谱的辅助绘制。Mapping module, the first input end is connected to the output end of the detection module, the second input end is connected to the output end of the identification partition module, and the neuron cell body and the mouse brain microscopic image partition are carried out one by one. Mapping, obtaining the partition information of the mouse brain microscopic image partitions, and completing the auxiliary drawing of the mouse brain atlas.
CN201911017554.1A 2019-10-24 2019-10-24 Computer vision-based mouse brain map drawing auxiliary system and method Active CN110751112B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911017554.1A CN110751112B (en) 2019-10-24 2019-10-24 Computer vision-based mouse brain map drawing auxiliary system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911017554.1A CN110751112B (en) 2019-10-24 2019-10-24 Computer vision-based mouse brain map drawing auxiliary system and method

Publications (2)

Publication Number Publication Date
CN110751112A CN110751112A (en) 2020-02-04
CN110751112B true CN110751112B (en) 2023-10-03

Family

ID=69279718

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911017554.1A Active CN110751112B (en) 2019-10-24 2019-10-24 Computer vision-based mouse brain map drawing auxiliary system and method

Country Status (1)

Country Link
CN (1) CN110751112B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111887813A (en) * 2020-08-11 2020-11-06 南通大学 Method and device for recognizing brain region position of fresh in-vitro tissue
CN115049626A (en) * 2022-06-27 2022-09-13 华中科技大学苏州脑空间信息研究院 Map-assisted drawing method, computer-readable storage medium and electronic device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2827167A1 (en) * 2013-07-17 2015-01-21 Samsung Electronics Co., Ltd Method and apparatus for selecting seed area for tracking nerve fibers in brain
CN106920228A (en) * 2017-01-19 2017-07-04 北京理工大学 The method for registering and device of brain map and brain image
CN108197564A (en) * 2017-12-29 2018-06-22 复旦大学附属中山医院 A kind of assessment system and method for drawing clock experiment
CN110197729A (en) * 2019-05-20 2019-09-03 华南理工大学 Tranquillization state fMRI data classification method and device based on deep learning

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015002846A2 (en) * 2013-07-02 2015-01-08 Surgical Information Sciences, Inc. Method and system for a brain image pipeline and brain image region location and shape prediction
US10643396B2 (en) * 2016-11-11 2020-05-05 Microbrightfield, Inc. Methods and software for creating a 3D image from images of multiple histological sections and for mapping anatomical information from a reference atlas to a histological image
US10984054B2 (en) * 2017-07-27 2021-04-20 Robert Bosch Gmbh Visual analytics system for convolutional neural network based classifiers
EP3692536A1 (en) * 2017-10-02 2020-08-12 Blackthorn Therapeutics, Inc. Methods and systems for computer-generated predictive application of neuroimaging and gene expression mapping data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2827167A1 (en) * 2013-07-17 2015-01-21 Samsung Electronics Co., Ltd Method and apparatus for selecting seed area for tracking nerve fibers in brain
CN106920228A (en) * 2017-01-19 2017-07-04 北京理工大学 The method for registering and device of brain map and brain image
CN108197564A (en) * 2017-12-29 2018-06-22 复旦大学附属中山医院 A kind of assessment system and method for drawing clock experiment
CN110197729A (en) * 2019-05-20 2019-09-03 华南理工大学 Tranquillization state fMRI data classification method and device based on deep learning

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
大鼠脑组织切片的显微反射红外光谱;姚杰,李茜,陈维,刘玉芳,王丹;光谱学与光谱分析;第36卷(第S1期);137-138 *

Also Published As

Publication number Publication date
CN110751112A (en) 2020-02-04

Similar Documents

Publication Publication Date Title
CN111275688B (en) Small target detection method based on context feature fusion screening of attention mechanism
CN108734120B (en) Method, device and equipment for labeling image and computer readable storage medium
CN110705425B (en) Tongue picture multi-label classification method based on graph convolution network
CN111898523A (en) A target detection method for special vehicles in remote sensing images based on transfer learning
Hao et al. Solder joint inspection based on neural network combined with genetic algorithm
CN107862694A (en) A kind of hand-foot-and-mouth disease detecting system based on deep learning
CN113826143A (en) Feature point detection
CN111679291A (en) Inspection robot target positioning configuration method based on three-dimensional laser radar
CN110210545A (en) Infrared remote sensing water body classifier construction method based on transfer learning
CN110097053A (en) A kind of power equipment appearance defect inspection method based on improvement Faster-RCNN
CN110751112B (en) Computer vision-based mouse brain map drawing auxiliary system and method
CN110929795B (en) Method for quickly identifying and positioning welding spot of high-speed wire welding machine
WO2022089143A1 (en) Method for generating analog image, and electronic device and storage medium
US20240185568A1 (en) Image Classification Method and Related Device Thereof
CN109934804A (en) Detection method of Alzheimer's lesion area based on convolutional neural network
CN114273826A (en) Automatic identification method for welding position of large-sized workpiece to be welded
CN115410024A (en) Power image defect detection method based on dynamic activation thermodynamic diagram
CN115880266A (en) Intestinal polyp detection system and method based on deep learning
CN113793385A (en) Method and device for positioning fish head and fish tail
CN116739949B (en) Blastomere edge enhancement processing method of embryo image
CN118552718A (en) A few-shot target detection method based on feature distribution correction
CN111738264A (en) An intelligent collection method of display panel data of equipment room equipment
CN115937492B (en) Feature recognition-based infrared image recognition method for power transformation equipment
CN117351489A (en) Head and neck tumor target area delineating system for whole-body PET/CT scanning
CN116958535A (en) A polyp segmentation system and method based on multi-scale residual reasoning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant