CN117132813A - Microfluidic chip channel identification method, device, equipment and readable storage medium - Google Patents

Microfluidic chip channel identification method, device, equipment and readable storage medium Download PDF

Info

Publication number
CN117132813A
CN117132813A CN202311076319.8A CN202311076319A CN117132813A CN 117132813 A CN117132813 A CN 117132813A CN 202311076319 A CN202311076319 A CN 202311076319A CN 117132813 A CN117132813 A CN 117132813A
Authority
CN
China
Prior art keywords
image
microfluidic chip
target
channel
chip channel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311076319.8A
Other languages
Chinese (zh)
Inventor
廖丽敏
晏昊东
曾杰生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Foshan Dingzhi Biotechnology Co ltd
Guangdong Foshan Lianchuang Engineering Graduate School
Guangdong Shunde Industrial Design Institute
Original Assignee
Foshan Dingzhi Biotechnology Co ltd
Guangdong Foshan Lianchuang Engineering Graduate School
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Foshan Dingzhi Biotechnology Co ltd, Guangdong Foshan Lianchuang Engineering Graduate School filed Critical Foshan Dingzhi Biotechnology Co ltd
Priority to CN202311076319.8A priority Critical patent/CN117132813A/en
Publication of CN117132813A publication Critical patent/CN117132813A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/28Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A10/00TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE at coastal zones; at river basins
    • Y02A10/40Controlling or monitoring, e.g. of flood or hurricane; Forecasting, e.g. risk assessment or mapping

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Biochemistry (AREA)
  • Evolutionary Computation (AREA)
  • Immunology (AREA)
  • Artificial Intelligence (AREA)
  • Analytical Chemistry (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Chemical & Material Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

The application belongs to the technical field of micro-fluidic chip quality detection, and discloses a micro-fluidic chip channel identification method, a device, equipment and a readable storage medium, which comprise the following steps: acquiring an image of a microfluidic chip acquired by an imaging sensor; preprocessing an image of a microfluidic chip to obtain a first image; sliding on the first image by using a sliding window with a preset size, and storing the central coordinate of the sliding window meeting the preset condition as a first target point to a target coordinate list; judging whether all first target points in the target coordinate list are in a micro-fluidic chip channel or not; performing water-diffusion filling treatment by taking a first target point in a chip channel as a seed point to obtain an image mask of a channel image in the microfluidic chip image; and cutting out the image of the microfluidic chip by using the image mask to obtain a target image only containing channels of the microfluidic chip. The application can realize the efficient and high-precision division of the channels in the image of the microfluidic chip.

Description

微流控芯片通道识别方法、装置、设备及可读存储介质Microfluidic chip channel identification method, device, equipment and readable storage medium

技术领域Technical field

本申请涉及微流控芯片质量检测的技术领域,尤其涉及一种微流控芯片通道识别方法、装置、设备及可读存储介质。The present application relates to the technical field of microfluidic chip quality detection, and in particular to a microfluidic chip channel identification method, device, equipment and readable storage medium.

背景技术Background technique

生物芯片技术起源于二十世纪八十年代,也被称为“微流控技术”、“芯片实验室”等。它是一项能把生物、化学和医学分析过程中的样品制备、反应、分离、检测等基本操作,集成到一块微米尺度的芯片上完成的技术,并可以自动完成分析全过程,具有成本低、样本少、时间短、操作简单的特点。对比微流控芯片行业发展的日益成熟,微流控芯片质量检测技术发展相对滞后,由于微流控芯片本身体积小的特点,其通道肉眼不可见,需人工借助一体化平台进行观察,而长时间的人工目检,容易使检测人员的视力产生疲劳,进而影响检测结果。目前,人工目视检测仍然是微流控芯片主要检测手段。Biochip technology originated in the 1980s and is also known as "microfluidic technology", "lab on a chip", etc. It is a technology that can integrate basic operations such as sample preparation, reaction, separation, and detection in biological, chemical, and medical analysis processes onto a micron-scale chip. It can automatically complete the entire analysis process and has low cost. , few samples, short time, and simple operation. Compared with the increasingly mature development of the microfluidic chip industry, the development of microfluidic chip quality inspection technology is relatively lagging behind. Due to the small size of the microfluidic chip itself, its channels are invisible to the naked eye and require manual observation with the help of an integrated platform. Long-term manual visual inspection can easily fatigue the inspection personnel's vision, thus affecting the inspection results. At present, manual visual inspection is still the main inspection method for microfluidic chips.

而针对微流控芯片图像,可以设计算法寻找图像中的芯片通道部分,从而实现对微流控芯片图像中通道的划分。但是数字PCR仪微流控芯片通道图像主要有两个技术难点,包括拍照通道不完整及芯片整体透明,导致微流控芯片通道图像的通道识别困难。其中,芯片整体呈透明状,颜色由光照条件下背景颜色所决定,不具备颜色特征,且在液滴出口位置较厚,光照条件下有部分阴影影响观察通道。拍照通道不完整,无法观察到整体图像,不同于常规检测手段中,目标完整的在图像中,想要观察到微流控芯片通道的情况下,无法观察整体,只能对芯片各个结构依次观察,从而确定芯片通道是否干净,即无法使用传统图像处理中模板匹配的方式来完成检测。For microfluidic chip images, algorithms can be designed to find the chip channel part in the image, thereby achieving the division of channels in the microfluidic chip image. However, there are two main technical difficulties in digital PCR instrument microfluidic chip channel images, including incomplete camera channels and overall transparency of the chip, which makes it difficult to identify channels in microfluidic chip channel images. Among them, the chip is transparent as a whole, and its color is determined by the background color under lighting conditions. It has no color characteristics, and is thicker at the droplet outlet. There are some shadows that affect the observation channel under lighting conditions. The photographing channel is incomplete and the overall image cannot be observed. Unlike conventional detection methods, the target is completely in the image. If you want to observe the microfluidic chip channel, you cannot observe the entire structure and can only observe each structure of the chip in sequence. , thereby determining whether the chip channel is clean, that is, the detection cannot be completed using template matching in traditional image processing.

发明内容Contents of the invention

本申请提供了一种微流控芯片通道识别方法、装置、设备及可读存储介质,可以实现对微流控芯片图像中通道的高效高精度的划分。This application provides a microfluidic chip channel identification method, device, equipment and readable storage medium, which can achieve efficient and high-precision division of channels in microfluidic chip images.

第一方面,本申请实施例提供了一种微流控芯片通道识别方法,该方法包括:In a first aspect, embodiments of the present application provide a microfluidic chip channel identification method, which method includes:

获取成像传感器所采集的微流控芯片图像;Obtain the microfluidic chip image collected by the imaging sensor;

对微流控芯片图像进行预处理,得到第一图像,其中,所述预处理包括图像增强、图像二值化以及小目标移除;Preprocess the microfluidic chip image to obtain a first image, wherein the preprocessing includes image enhancement, image binarization and small target removal;

使用预设尺寸的滑动窗口在第一图像上滑动,将满足预设条件的滑动窗口的中心坐标作为第一目标点保存至目标坐标列表,其中,预设条件为滑动窗口中出现目标像素值的坐标点;Use a sliding window of preset size to slide on the first image, and save the center coordinate of the sliding window that meets the preset conditions as the first target point to the target coordinate list, where the preset condition is that the target pixel value appears in the sliding window. Coordinate points;

判断目标坐标列表中所有的第一目标点是否在微流控芯片通道内;Determine whether all first target points in the target coordinate list are within the microfluidic chip channel;

将在芯片通道内的第一目标点作为种子点进行漫水填充处理,得到微流控芯片图像中通道图像的图像掩码,其中,经过漫水填充处理的种子点灰度值为目标像素值;The first target point in the chip channel is used as a seed point for flood filling processing to obtain an image mask of the channel image in the microfluidic chip image, in which the gray value of the seed point that has been flooded and filled is the target pixel value ;

利用所述图像掩码裁剪微流控芯片图像,得到仅包含微流控芯片通道的目标图像。The image mask is used to crop the microfluidic chip image to obtain a target image containing only the microfluidic chip channels.

进一步的,所述对微流控芯片图像进行预处理,得到第一图像的步骤包括:Further, the step of preprocessing the microfluidic chip image to obtain the first image includes:

基于retinex算法发展的MSRCP算法对微流控芯片图像进行图像增强,得到第二图像;The MSRCP algorithm developed based on the retinex algorithm performs image enhancement on the microfluidic chip image to obtain the second image;

基于自适应均衡化算法对第二图像进行二值化处理,得到第三图像,其中,二值化处理时微流控芯片图像中微流控芯片通道轮廓部分的灰度值设置为目标像素值;The second image is binarized based on the adaptive equalization algorithm to obtain a third image. During the binarization process, the gray value of the microfluidic chip channel outline part in the microfluidic chip image is set to the target pixel value. ;

基于小目标移除算法对第三图像进行背景杂质移除处理,得到第一图像,其中,背景杂质移除处理时移除整体像素值个数不大于预设阈值的连通区域。The background impurity removal process is performed on the third image based on the small target removal algorithm to obtain the first image, wherein during the background impurity removal process, connected areas whose overall number of pixel values is not greater than a preset threshold are removed.

进一步的,所述判断目标坐标列表中所有的第一目标点是否在微流控芯片通道内的步骤包括:Further, the step of determining whether all first target points in the target coordinate list are within the microfluidic chip channel includes:

对目标坐标列表中所有的第一目标点进行检查,其中,检查包括以第一目标点为中心,向上下左右四个方向发射长度不大于滑动窗口长宽最小值的线段,并确定线段与第一图像中微流控芯片通道轮廓部分的交点;Check all the first target points in the target coordinate list, where the check includes taking the first target point as the center, emitting line segments with a length not greater than the minimum length and width of the sliding window in four directions, and determining the distance between the line segment and the first target point. The intersection point of the outline portion of the microfluidic chip channel in an image;

若上下方向或者左右方向的线段同时有交点且上下方向或者左右方向的线段两边交点数之差的绝对值小于预设差值时,则确定所述第一目标点在微流控芯片通道内。If the line segments in the up and down direction or the left and right directions have intersection points at the same time and the absolute value of the difference in the number of intersection points on both sides of the line segments in the up and down direction or the left and right direction is less than the preset difference, then it is determined that the first target point is within the microfluidic chip channel.

进一步的,所述预设尺寸设置为第一图像尺寸大小的16分之一。Further, the preset size is set to one-sixteenth of the first image size.

第二方面,本发明还提供一种微流控芯片通道识别装置,所述装置包括:In a second aspect, the present invention also provides a microfluidic chip channel identification device, which device includes:

获取模块,用于获取成像传感器所采集的微流控芯片图像;An acquisition module is used to acquire the microfluidic chip image collected by the imaging sensor;

图像预处理模块,用于对微流控芯片图像进行预处理,得到第一图像,其中,所述预处理包括图像增强、图像二值化以及小目标移除;An image preprocessing module, used to preprocess the microfluidic chip image to obtain the first image, where the preprocessing includes image enhancement, image binarization and small target removal;

滑动窗口处理模块,用于使用预设尺寸的滑动窗口在第一图像上滑动,将满足预设条件的滑动窗口的中心坐标作为第一目标点保存至目标坐标列表,其中,预设条件为滑动窗口中出现目标像素值的坐标点;The sliding window processing module is used to slide on the first image using a sliding window of a preset size, and save the center coordinates of the sliding window that meets the preset conditions as the first target point to the target coordinate list, where the preset condition is sliding The coordinate point of the target pixel value appears in the window;

判断模块,用于判断目标坐标列表中所有的第一目标点是否在微流控芯片通道内;A judgment module used to judge whether all first target points in the target coordinate list are within the microfluidic chip channel;

漫水填充处理模块,用于将在芯片通道内的第一目标点作为种子点进行漫水填充处理,得到微流控芯片图像中通道图像的图像掩码,其中,经过漫水填充处理的种子点灰度值为目标像素值;The flood filling processing module is used to perform flooding filling processing on the first target point in the chip channel as a seed point to obtain an image mask of the channel image in the microfluidic chip image, wherein the seeds that have been flooded filling processed The point gray value is the target pixel value;

裁剪模块,用于利用所述图像掩码裁剪微流控芯片图像,得到仅包含微流控芯片通道的目标图像。A cropping module is used to crop the microfluidic chip image using the image mask to obtain a target image containing only the microfluidic chip channel.

进一步的,所述图像预处理模块,具体用于:Further, the image preprocessing module is specifically used for:

基于retine微流控芯片通道识别算法发展的MSRCP算法对微流控芯片图像进行图像增强,得到第二图像;The MSRCP algorithm developed based on the retine microfluidic chip channel recognition algorithm performs image enhancement on the microfluidic chip image to obtain the second image;

基于自适应均衡化算法对第二图像进行二值化处理,得到第三图像,其中,二值化处理时微流控芯片图像中微流控芯片通道轮廓部分的灰度值设置为目标像素值;The second image is binarized based on the adaptive equalization algorithm to obtain a third image. During the binarization process, the gray value of the microfluidic chip channel outline part in the microfluidic chip image is set to the target pixel value. ;

基于小目标移除算法对第三图像进行背景杂质移除处理,得到第一图像,其中,背景杂质移除处理时移除整体像素值个数不大于预设阈值的连通区域。The background impurity removal process is performed on the third image based on the small target removal algorithm to obtain the first image, wherein during the background impurity removal process, connected areas whose overall number of pixel values is not greater than a preset threshold are removed.

进一步的,所述判断模块,具体用于:Further, the judgment module is specifically used for:

对目标坐标列表中所有的第一目标点进行检查,其中,检查包括以第一目标点为中心,向上下左右四个方向发射长度不大于滑动窗口长宽最小值的线段,并确定线段与第一图像中微流控芯片通道轮廓部分的交点;Check all the first target points in the target coordinate list, where the check includes taking the first target point as the center, emitting line segments with a length not greater than the minimum length and width of the sliding window in four directions, and determining the distance between the line segment and the first target point. The intersection point of the outline portion of the microfluidic chip channel in an image;

若上下方向或者左右方向的线段同时有交点且上下方向或者左右方向的线段两边交点数之差的绝对值小于预设差值时,则确定所述第一目标点在微流控芯片通道内。If the line segments in the up and down direction or the left and right directions have intersection points at the same time and the absolute value of the difference in the number of intersection points on both sides of the line segments in the up and down direction or the left and right direction is less than the preset difference, then it is determined that the first target point is within the microfluidic chip channel.

进一步的,所述预设尺寸设置为第一图像尺寸大小的16分之一。Further, the preset size is set to one-sixteenth of the first image size.

第三方面,本申请实施例还提供一种微流控芯片通道识别设备,所述微流控芯片通道识别设备包括处理器、存储器、以及存储在所述存储器上并可被所述处理器执行的微流控芯片通道识别程序,其中所述微流控芯片通道识别程序被所述处理器执行时,实现如上述所述的微流控芯片通道识别方法的步骤。In a third aspect, embodiments of the present application also provide a microfluidic chip channel identification device. The microfluidic chip channel identification device includes a processor, a memory, and a device that is stored in the memory and can be executed by the processor. A microfluidic chip channel identification program, wherein when the microfluidic chip channel identification program is executed by the processor, the steps of the microfluidic chip channel identification method described above are implemented.

第四方面,本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有微流控芯片通道识别程序,其中所述微流控芯片通道识别程序被处理器执行时,实现如上述所述的微流控芯片通道识别方法的步骤。In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium. A microfluidic chip channel identification program is stored on the computer-readable storage medium, wherein the microfluidic chip channel identification program is executed by a processor. When, the steps of the microfluidic chip channel identification method as described above are implemented.

综上,与现有技术相比,本申请实施例提供的技术方案带来的有益效果至少包括:To sum up, compared with the existing technology, the beneficial effects brought by the technical solutions provided by the embodiments of the present application at least include:

本申请实施例提供的一种微流控芯片通道识别方法、装置、设备及可读存储介质,本申请中对所采集的微流控芯片图像进行预处理、滑动窗口处理、漫水处理以及裁剪处理,得到仅包含微流控芯片通道的目标图像,可以实现对微流控芯片图像中通道的高效高精度的划分。且所得的目标图像也是对应只包含微流控芯片图像中可见的芯片通道部分,因此可以及时辅助人工目检,替代现有进行人工目检时确定通道位置的步骤,后续人工目检可以再在确定的目标图像上再检测通道是否存在异物、质量瑕疵等问题,以较好的缓解人工目检中检测人员的视力疲劳。The embodiments of this application provide a microfluidic chip channel identification method, device, equipment and readable storage medium. In this application, the collected microfluidic chip images are preprocessed, sliding window processed, flooded and cropped. After processing, a target image containing only the microfluidic chip channels is obtained, which can achieve efficient and high-precision division of channels in the microfluidic chip image. Moreover, the obtained target image also corresponds to only the visible part of the chip channel in the microfluidic chip image, so it can promptly assist manual visual inspection and replace the existing step of determining the channel position during manual visual inspection. Subsequent manual visual inspection can be performed again. On the determined target image, the channel is then inspected for foreign matter, quality defects and other issues to better alleviate the visual fatigue of inspection personnel during manual visual inspection.

附图说明Description of the drawings

图1为本申请一个实施例提供的微流控芯片通道识别方法的流程示意图;Figure 1 is a schematic flow chart of a microfluidic chip channel identification method provided by one embodiment of the present application;

图2为本申请一个实施例提供的微流控芯片通道识别方法的滑动窗口处理示意图;Figure 2 is a schematic diagram of sliding window processing of a microfluidic chip channel identification method provided by an embodiment of the present application;

图3为本申请一个实施例提供的微流控芯片通道识别装置的功能模块示意图;Figure 3 is a schematic diagram of the functional modules of the microfluidic chip channel identification device provided by one embodiment of the present application;

图4为本申请一个实施例方案中涉及的微流控芯片通道识别设备的硬件结构示意图。Figure 4 is a schematic diagram of the hardware structure of the microfluidic chip channel identification device involved in one embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

请参见图1,本申请实施例提供了微流控芯片通道识别方法,该方法具体包括:Please refer to Figure 1. This embodiment of the present application provides a microfluidic chip channel identification method. The method specifically includes:

步骤S10,获取成像传感器所采集的微流控芯片图像;Step S10, obtain the microfluidic chip image collected by the imaging sensor;

步骤S20,对微流控芯片图像进行预处理,得到第一图像,其中,所述预处理包括图像增强、图像二值化以及小目标移除;Step S20, preprocess the microfluidic chip image to obtain a first image, where the preprocessing includes image enhancement, image binarization and small target removal;

步骤S30,使用预设尺寸的滑动窗口在第一图像上滑动,将满足预设条件的滑动窗口的中心坐标作为第一目标点保存至目标坐标列表,其中,预设条件为滑动窗口中出现目标像素值的坐标点;Step S30: Use a sliding window of a preset size to slide on the first image, and save the center coordinates of the sliding window that meets the preset conditions as the first target point to the target coordinate list, where the preset condition is that the target appears in the sliding window. The coordinate point of the pixel value;

步骤S40,判断目标坐标列表中所有的第一目标点是否在微流控芯片通道内;Step S40, determine whether all first target points in the target coordinate list are within the microfluidic chip channel;

步骤S50,将在芯片通道内的第一目标点作为种子点进行漫水填充处理,得到微流控芯片图像中通道图像的图像掩码,其中,经过漫水填充处理的种子点灰度值为目标像素值;Step S50, use the first target point in the chip channel as a seed point to perform flooding filling processing, and obtain an image mask of the channel image in the microfluidic chip image, where the gray value of the seed point after flooding filling processing is target pixel value;

步骤S60,利用所述图像掩码裁剪微流控芯片图像,得到仅包含微流控芯片通道的目标图像。Step S60: Use the image mask to crop the microfluidic chip image to obtain a target image containing only microfluidic chip channels.

本实施例中,微流控芯片图像是在自然光的照射下,使用成像传感器如数字显微镜对芯片直接拍照得到。考虑到现有方案拍照通道不完整及芯片整体透明的两个技术难点导致微流控芯片通道图像的通道识别困难的情况下,常规的模板匹配策略在寻找微流控芯片图像中的芯片通道部分时,由于无法观察到整体,只能得到部分芯片通道,由于透明的特性,得到的只是芯片通道的轮廓而非通道,无法实现对微流控芯片图像中通道的划分。因此本实施例方案为了实现对微流控芯片图像中通道的高效高精度的划分,在获取成像传感器采集的微流控芯片图像后,会对所采集的微流控芯片图像进行预处理、滑动窗口处理、漫水处理以及裁剪处理,得到仅包含微流控芯片通道的目标图像。其中,微流控芯片图像中仅包含部分芯片通道图像,所得的目标图像也是对应只包含微流控芯片图像中可见的芯片通道部分。虽然目标图像只包含微流控芯片图像中可见的芯片通道部分,但是由于目标图像仅包含微流控芯片通道,因此可以及时辅助人工目检,替代现有进行人工目检时确定通道位置的步骤,后续人工目检可以再在确定的目标图像上再检测通道是否存在异物、质量瑕疵等问题,以较好的缓解人工目检中检测人员的视力疲劳。In this embodiment, the image of the microfluidic chip is obtained by using an imaging sensor such as a digital microscope to directly photograph the chip under the illumination of natural light. Considering that the two technical difficulties of the existing solution, incomplete camera channels and the overall transparency of the chip, make it difficult to identify the channel in the microfluidic chip channel image, the conventional template matching strategy is used to find the chip channel part in the microfluidic chip image. At this time, because the whole cannot be observed, only part of the chip channels can be obtained. Due to the transparent characteristics, only the outline of the chip channel is obtained instead of the channel. It is impossible to divide the channels in the microfluidic chip image. Therefore, in order to achieve efficient and high-precision division of channels in the microfluidic chip image, this embodiment scheme will preprocess and slide the collected microfluidic chip image after acquiring the microfluidic chip image collected by the imaging sensor. Window processing, flood processing and cropping processing are used to obtain the target image containing only the microfluidic chip channel. Among them, the microfluidic chip image only contains part of the chip channel image, and the obtained target image also corresponds to only containing the visible part of the chip channel in the microfluidic chip image. Although the target image only contains the part of the chip channel that is visible in the microfluidic chip image, since the target image only contains the microfluidic chip channel, it can assist manual visual inspection in time, replacing the existing step of determining the channel position during manual visual inspection. , the subsequent manual visual inspection can then detect whether there are foreign objects, quality defects and other problems in the channel on the determined target image, so as to better alleviate the visual fatigue of the inspection personnel during manual visual inspection.

具体地,由于芯片整体透明,微流控芯片通道轮廓部分与芯片中其他部分区分并不明显,因此在获取得到成像传感器所采集的微流控芯片图像后,会对微流控芯片图像进行包括图像增强、图像二值化以及小目标移除的预处理,得到第一图像。其中,通过图像增强可以提升微流控芯片图像中的通道轮廓(对应阴影部分)的亮度,从而使得芯片轮廓与其他芯片部分的对比更加明显,为后续执行的图像处理算法打下基础。由于主要是需要划分微流控芯片中的通道,因此可将芯片通道轮廓部分的灰度值与其他部分的灰度值进行二值化处理进行区分。此外,由于除了其他部分也可能出现与芯片通道轮廓部分相似的小目标,这些小目标可能会成为噪点干扰之后对于芯片图像中的通道划分,因此还会在对微流控芯片图像进行二值化处理时,对微流控芯片图像进行小目标移除,从而确保保留的通道轮廓更加清晰精确。Specifically, since the chip is transparent as a whole, the outline of the microfluidic chip channel is not clearly distinguished from other parts of the chip. Therefore, after obtaining the microfluidic chip image collected by the imaging sensor, the microfluidic chip image will be included Preprocessing of image enhancement, image binarization and small target removal to obtain the first image. Among them, image enhancement can improve the brightness of the channel outline (corresponding to the shaded part) in the microfluidic chip image, thereby making the contrast between the chip outline and other chip parts more obvious, laying the foundation for subsequent image processing algorithms. Since it is mainly necessary to divide the channels in the microfluidic chip, the gray value of the contour part of the chip channel can be binarized to distinguish it from the gray value of other parts. In addition, since there may also be small targets similar to the chip channel outline in other parts, these small targets may become noise interference for the channel division in the chip image. Therefore, the microfluidic chip image will also be binarized. During processing, small targets are removed from the microfluidic chip image to ensure that the retained channel contours are clearer and more precise.

在确定保留的通道轮廓更加清晰精确的基础上,为了基于通道轮廓划分更为精确的实际通道内区域,本实施例方案会对预处理后得到的第一图像进行滑动窗口处理以及漫水处理,从而得到通道内区域的图像掩码。其中,在对第一图像进行滑动窗口处理时,会使用预设尺寸的滑动窗口在第一图像上滑动,当滑动窗口中出现目标像素值(对应二值化后芯片通道轮廓部分的灰度值)的坐标点时,则确认滑动窗口接触到了芯片通道轮廓点。参照图2,此时可以将滑动窗口的中心坐标作为第一目标点保存至目标坐标列表。在整张的第一图像上滑动完成后,通过判断目标坐标列表中的第一目标点是否位于微流控芯片通道内,可以确定是否需要将第一目标点作为种子点进行漫水处理。On the basis of determining that the retained channel contour is clearer and more accurate, in order to divide a more accurate area within the actual channel based on the channel contour, this embodiment will perform sliding window processing and flooding processing on the first image obtained after preprocessing. Thus, the image mask of the area within the channel is obtained. Among them, when performing sliding window processing on the first image, a sliding window of preset size will be used to slide on the first image. When the target pixel value (corresponding to the grayscale value of the chip channel outline part after binarization) appears in the sliding window ) coordinate point, confirm that the sliding window touches the chip channel outline point. Referring to Figure 2, at this time, the center coordinate of the sliding window can be saved to the target coordinate list as the first target point. After sliding on the entire first image, by determining whether the first target point in the target coordinate list is located in the microfluidic chip channel, it can be determined whether the first target point needs to be used as a seed point for water flooding processing.

在芯片通道内的第一目标点即可作为种子点进行漫水填充处理,以芯片通道的轮廓为界,将坐标点设置到通道中间,漫水得到微流控芯片图像中芯片通道的图像掩码。将在芯片通道内的第一目标点作为种子点进行漫水填充处理,得到微流控芯片图像中通道图像的图像掩码时,会实时检测种子点是否已经经过漫水处理,经过漫水处理后,第一图像上的通道轮廓内包括通道轮廓均保持为同一像素值,即二值化时所设置的通道轮廓部分的目标像素值,当目标像素值设置为255时,则经过漫水填充处理的种子点灰度值也为255。再利用该图像掩码来裁剪原来直接获得的微流控芯片图像,即可得到仅包含微流控芯片通道的目标图像。The first target point in the chip channel can be used as a seed point for flooding filling processing. Taking the outline of the chip channel as the boundary, set the coordinate point to the middle of the channel, and flood the water to obtain the image mask of the chip channel in the microfluidic chip image. code. The first target point in the chip channel is used as a seed point for flooding processing. When the image mask of the channel image in the microfluidic chip image is obtained, it will be detected in real time whether the seed point has been flooded. After the flooding processing Finally, the channel outline on the first image, including the channel outline, remains at the same pixel value, that is, the target pixel value of the channel outline part set during binarization. When the target pixel value is set to 255, it is filled with water. The gray value of the processed seed point is also 255. This image mask is then used to crop the original directly obtained microfluidic chip image, and a target image containing only the microfluidic chip channel can be obtained.

进一步地,一实施例中,所述步骤S20包括:Further, in one embodiment, the step S20 includes:

基于retine微流控芯片通道识别算法发展的MSRCP算法对微流控芯片图像进行图像增强,得到第二图像;The MSRCP algorithm developed based on the retine microfluidic chip channel recognition algorithm performs image enhancement on the microfluidic chip image to obtain the second image;

基于自适应均衡化算法对第二图像进行二值化处理,得到第三图像,其中,二值化处理时微流控芯片图像中微流控芯片通道轮廓部分的灰度值设置为目标像素值;The second image is binarized based on the adaptive equalization algorithm to obtain a third image. During the binarization process, the gray value of the microfluidic chip channel outline part in the microfluidic chip image is set to the target pixel value. ;

基于小目标移除算法对第三图像进行背景杂质移除处理,得到第一图像,其中,背景杂质移除处理时移除整体像素值个数不大于预设阈值的连通区域。The background impurity removal process is performed on the third image based on the small target removal algorithm to obtain the first image, wherein during the background impurity removal process, connected areas whose overall number of pixel values is not greater than a preset threshold are removed.

本实施例中,对微流控芯片图像进行包括图像增强、图像二值化以及小目标移除的预处理时,对比常见的图像增强算法,如直方图均衡化、灰度世界算法、Retinex算法、自动白平衡、自动色彩均衡等图像增强算法,基于retinex算法发展的MSRCP算法,对微流控芯片图像中的芯片通道轮廓(阴影部分)的亮度提升最明显,因此会先使用基于retine微流控芯片通道识别算法发展的MSRCP算法对微流控芯片图像进行图像增强,得到第二图像。在图像增强后,即可直接使用OpenCV中的自适应均衡化算法对图像增强后的微流控芯片图像进行二值化处理,二值化后的微流控芯片图像,芯片通道轮廓部分的灰度值可为255,其余部分可为0,此时目标像素值即可255。其中,二值化后,除通道部分出现的其他白色部分均看做背景杂质,白色部分(包括通道轮廓部分以及背景杂质部分)对应的灰度值均为255。针对二值化后出现的背景杂质部分,本实施例方案直接使用OpenCV中的小目标移除算法,使用函数保留连通区域整体像素值个数大于预设阈值的区域,经过试验确定,预设阈值(对应连通区域最小像素值)优选设置为4000。通过使用函数保留连通区域整体像素值个数大于4000的区域,移除周围的孤立像素,从而达到使通道轮廓更加清晰精确的目的。In this embodiment, when preprocessing the microfluidic chip image including image enhancement, image binarization, and small target removal, common image enhancement algorithms are compared, such as histogram equalization, grayscale world algorithm, and Retinex algorithm. , automatic white balance, automatic color balance and other image enhancement algorithms. The MSRCP algorithm developed based on the retinex algorithm has the most significant improvement in the brightness of the chip channel outline (shaded part) in the microfluidic chip image. Therefore, the retine microfluidic based algorithm will be used first. The MSRCP algorithm developed from the microfluidic chip channel identification algorithm performs image enhancement on the microfluidic chip image to obtain a second image. After image enhancement, you can directly use the adaptive equalization algorithm in OpenCV to binarize the enhanced microfluidic chip image. The binarized microfluidic chip image, the gray of the chip channel outline, The degree value can be 255, and the rest can be 0. In this case, the target pixel value can be 255. Among them, after binarization, all white parts except the channel part are regarded as background impurities, and the corresponding grayscale values of the white parts (including the channel outline part and the background impurity part) are all 255. For the background impurities that appear after binarization, this embodiment directly uses the small target removal algorithm in OpenCV, and uses a function to retain the area where the overall number of pixel values in the connected area is greater than the preset threshold. It is determined through experiments that the preset threshold (corresponding to the minimum pixel value of the connected area) is preferably set to 4000. By using a function to retain the area where the overall number of pixel values in the connected area is greater than 4000, and removing the surrounding isolated pixels, the purpose of making the channel outline clearer and more accurate is achieved.

进一步地,一实施例中,所述步骤S40包括:Further, in one embodiment, the step S40 includes:

对目标坐标列表中所有的第一目标点进行检查,其中,检查包括以第一目标点为中心,向上下左右四个方向发射长度不大于滑动窗口长宽最小值的线段,并确定线段与第一图像中微流控芯片通道轮廓部分的交点;Check all the first target points in the target coordinate list, where the check includes taking the first target point as the center, emitting line segments with a length not greater than the minimum length and width of the sliding window in four directions, and determining the distance between the line segment and the first target point. The intersection point of the outline portion of the microfluidic chip channel in an image;

若上下方向或者左右方向的线段同时有交点且上下方向或者左右方向的线段两边交点数之差的绝对值小于预设差值时,则确定所述第一目标点在微流控芯片通道内。If the line segments in the up and down direction or the left and right directions have intersection points at the same time and the absolute value of the difference in the number of intersection points on both sides of the line segments in the up and down direction or the left and right direction is less than the preset difference, then it is determined that the first target point is within the microfluidic chip channel.

本实施例中,在判断目标坐标列表中所有的第一目标点是否在微流控芯片通道内,会对目标坐标列表中所有的第一目标点进行检查,以第一目标点为中心,向上下左右四个方向发射长度不大于窗口长宽最小值的线段,并确定线段与第一图像中微流控芯片通道轮廓部分的交点,以确定第一目标点是否在通道内。只有在上下方向或者左右方向的线段同时有交点,以及上下或者左右两边交点数之差的绝对值小于预设差值时,才可以确定所述第一目标点在微流控芯片通道轮廓内,除此之外的其他第一目标点均在微流控芯片通道轮廓外。其中,预设差值优选设置为3。通过上述方案的检查,可以排除掉不在微流控芯片通道轮廓内的种子点,后续基于筛选后的第一目标点进行漫水处理得到的图像掩码,可以更精准的区分表征微流控芯片通道部分与通道之外的其他部分,且上述筛选方式不需要额外进行其他图像处理,消耗的计算资源少,筛选速度也较快。In this embodiment, when determining whether all the first target points in the target coordinate list are in the microfluidic chip channel, all the first target points in the target coordinate list will be checked, with the first target point as the center, upward Line segments with lengths no greater than the minimum length and width of the window are emitted in the four directions, and the intersection point of the line segment with the outline of the microfluidic chip channel in the first image is determined to determine whether the first target point is within the channel. Only when the line segments in the up and down directions or the left and right directions have intersection points at the same time, and the absolute value of the difference between the number of intersection points on the up and down or left and right sides is less than the preset difference value, can it be determined that the first target point is within the microfluidic chip channel outline, Except for this, other first target points are outside the outline of the microfluidic chip channel. Among them, the preset difference value is preferably set to 3. Through the inspection of the above scheme, the seed points that are not within the channel outline of the microfluidic chip can be eliminated. The subsequent image mask obtained by flood processing based on the filtered first target point can more accurately distinguish and characterize the microfluidic chip. The channel part and other parts outside the channel, and the above filtering method does not require additional image processing, consumes less computing resources, and the filtering speed is also faster.

进一步地,一实施例中,所述预设尺寸设置为第一图像尺寸大小的16分之一。Further, in one embodiment, the preset size is set to one-sixteenth of the first image size.

本实施例中,采用滑动窗口对第一图像进行滑动处理时,滑动窗口的预设尺寸设置为第一图像尺寸大小的16分之一,主要是考虑到处理的第一图像大小可能不同,在实验中主要是2048x3096尺寸的图像,但也有可能是1024x72048的尺寸。考虑到适应不同尺寸的图像处理,设置为图片大小的16分之一。此外,滑动窗口的滑动步长优选设定为50px,即50个像素值,窗口从左向右,从上至下滑动,在移动距离小于50时,会直接移动到末尾位置,从而完成对整个第一图像的滑动处理。In this embodiment, when the sliding window is used to slide the first image, the preset size of the sliding window is set to one-sixteenth of the size of the first image, mainly because the size of the first image processed may be different. In the experiment, the images are mainly 2048x3096 size, but it may also be 1024x72048 size. Taking into account adapting to image processing of different sizes, it is set to one-sixteenth of the image size. In addition, the sliding step size of the sliding window is preferably set to 50px, that is, 50 pixel values. The window slides from left to right and from top to bottom. When the moving distance is less than 50, it will move directly to the end position, thereby completing the entire Sliding processing of the first image.

本申请实施例还提供一种微流控芯片通道识别装置。An embodiment of the present application also provides a microfluidic chip channel identification device.

参照图3,微流控芯片通道识别装置第一实施例的功能模块示意图。Refer to Figure 3, which is a schematic diagram of the functional modules of the first embodiment of the microfluidic chip channel identification device.

本实施例中,所述微流控芯片通道识别装置包括:In this embodiment, the microfluidic chip channel identification device includes:

获取模块10,用于获取成像传感器所采集的微流控芯片图像;The acquisition module 10 is used to acquire the microfluidic chip image collected by the imaging sensor;

图像预处理模块20,用于对微流控芯片图像进行预处理,得到第一图像,其中,所述预处理包括图像增强、图像二值化以及小目标移除;The image preprocessing module 20 is used to preprocess the microfluidic chip image to obtain the first image, where the preprocessing includes image enhancement, image binarization and small target removal;

滑动窗口处理模块30,用于使用预设尺寸的滑动窗口在第一图像上滑动,将满足预设条件的滑动窗口的中心坐标作为第一目标点保存至目标坐标列表,其中,预设条件为滑动窗口中出现目标像素值的坐标点;The sliding window processing module 30 is configured to use a sliding window of a preset size to slide on the first image, and save the center coordinates of the sliding window that meets the preset conditions as the first target point to the target coordinate list, where the preset condition is The coordinate point where the target pixel value appears in the sliding window;

判断模块40,用于判断目标坐标列表中所有的第一目标点是否在微流控芯片通道内;The judgment module 40 is used to judge whether all the first target points in the target coordinate list are within the microfluidic chip channel;

漫水填充处理模块,用于将在芯片通道内的第一目标点作为种子点进行漫水填充处理,得到微流控芯片图像中通道图像的图像掩码,其中,经过漫水填充处理的种子点灰度值为目标像素值;The flood filling processing module is used to perform flooding filling processing on the first target point in the chip channel as a seed point to obtain an image mask of the channel image in the microfluidic chip image, wherein the seeds that have been flooded filling processed The point gray value is the target pixel value;

裁剪模块50,用于利用所述图像掩码裁剪微流控芯片图像,得到仅包含微流控芯片通道的目标图像。The cropping module 50 is used to crop the microfluidic chip image using the image mask to obtain a target image containing only the microfluidic chip channel.

进一步地,一实施例中,所述图像预处理模块20,具体用于:Further, in one embodiment, the image preprocessing module 20 is specifically used for:

基于retine微流控芯片通道识别算法发展的MSRCP算法对微流控芯片图像进行图像增强,得到第二图像;The MSRCP algorithm developed based on the retine microfluidic chip channel recognition algorithm performs image enhancement on the microfluidic chip image to obtain the second image;

基于自适应均衡化算法对第二图像进行二值化处理,得到第三图像,其中,二值化处理时微流控芯片图像中微流控芯片通道轮廓部分的灰度值设置为目标像素值;The second image is binarized based on the adaptive equalization algorithm to obtain a third image. During the binarization process, the gray value of the microfluidic chip channel outline part in the microfluidic chip image is set to the target pixel value. ;

基于小目标移除算法对第三图像进行背景杂质移除处理,得到第一图像,其中,背景杂质移除处理时移除整体像素值个数不大于预设阈值的连通区域。The background impurity removal process is performed on the third image based on the small target removal algorithm to obtain the first image, wherein during the background impurity removal process, connected areas whose overall number of pixel values is not greater than a preset threshold are removed.

进一步地,一实施例中,所述判断模块40,具体用于:Further, in one embodiment, the judgment module 40 is specifically used to:

对目标坐标列表中所有的第一目标点进行检查,其中,检查包括以第一目标点为中心,向上下左右四个方向发射长度不大于滑动窗口长宽最小值的线段,并确定线段与第一图像中微流控芯片通道轮廓部分的交点;Check all the first target points in the target coordinate list, where the check includes taking the first target point as the center, emitting line segments with a length not greater than the minimum length and width of the sliding window in four directions, and determining the distance between the line segment and the first target point. The intersection point of the outline portion of the microfluidic chip channel in an image;

若上下方向或者左右方向的线段同时有交点且上下方向或者左右方向的线段两边交点数之差的绝对值小于预设差值时,则确定所述第一目标点在微流控芯片通道内。If the line segments in the up and down direction or the left and right directions have intersection points at the same time and the absolute value of the difference in the number of intersection points on both sides of the line segments in the up and down direction or the left and right direction is less than the preset difference, then it is determined that the first target point is within the microfluidic chip channel.

进一步地,一实施例中,所述预设尺寸设置为第一图像尺寸大小的16分之一。Further, in one embodiment, the preset size is set to one-sixteenth of the first image size.

其中,上述微流控芯片通道识别装置中各个模块的功能实现与上述微流控芯片通道识别方法实施例中各步骤相对应,其功能和实现过程在此处不再一一赘述。Among them, the functional implementation of each module in the above-mentioned microfluidic chip channel identification device corresponds to each step in the embodiment of the above-mentioned microfluidic chip channel identification method, and its functions and implementation processes will not be repeated here.

本申请实施例提供一种微流控芯片通道识别设备,该微流控芯片通道识别设备可以是个人计算机(personal computer,PC)、笔记本电脑、服务器等具有数据处理功能的设备。Embodiments of the present application provide a microfluidic chip channel identification device. The microfluidic chip channel identification device may be a personal computer (PC), notebook computer, server, or other device with data processing functions.

参照图4,图4为本申请实施例方案中涉及的微流控芯片通道识别设备的硬件结构示意图。本申请实施例中,微流控芯片通道识别设备可以包括处理器1001(例如中央处理器Central Processing Unit,CPU),通信总线1002,用户接口1003,网络接口1004,存储器1005。其中,通信总线1002用于实现这些组件之间的连接通信;用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard);网络接口1004可选的可以包括标准的有线接口、无线接口(如无线保真WIreless-FIdelity,WI-FI接口);存储器1005可以是高速随机存取存储器(random access memory,RAM),也可以是稳定的存储器(non-volatile memory),例如磁盘存储器,存储器1005可选的还可以是独立于前述处理器1001的存储装置。本领域技术人员可以理解,图微流控芯片通道识别中示出的硬件结构并不构成对本发明的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Referring to Figure 4, Figure 4 is a schematic diagram of the hardware structure of the microfluidic chip channel identification device involved in the embodiment of the present application. In the embodiment of the present application, the microfluidic chip channel identification device may include a processor 1001 (such as a Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize connection and communication between these components; the user interface 1003 can include a display screen (Display) and an input unit such as a keyboard (Keyboard); the network interface 1004 can optionally include a standard wired interface and a wireless interface. (such as wireless fidelity, WI-FI interface); the memory 1005 can be a high-speed random access memory (random access memory, RAM), or a stable memory (non-volatile memory), such as disk memory, memory 1005 may optionally be a storage device independent of the aforementioned processor 1001. Those skilled in the art can understand that the hardware structure shown in the microfluidic chip channel identification figure does not constitute a limitation of the present invention, and may include more or less components than shown in the figure, or combine certain components, or different Component placement.

继续参照图4,图4中作为一种计算机可读存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及微流控芯片通道识别程序。其中,处理器1001可以调用存储器1005中存储的微流控芯片通道识别程序,并执行本申请实施例提供的微流控芯片通道识别方法的步骤。Continuing to refer to Figure 4, the memory 1005 as a computer-readable storage medium in Figure 4 can include an operating system, a network communication module, a user interface module and a microfluidic chip channel identification program. The processor 1001 can call the microfluidic chip channel identification program stored in the memory 1005 and execute the steps of the microfluidic chip channel identification method provided by the embodiments of the present application.

其中,微流控芯片通道识别程序被执行时所实现的方法可参照本申请微流控芯片通道识别方法的各个实施例,此处不再赘述。For the method implemented when the microfluidic chip channel identification program is executed, reference can be made to various embodiments of the microfluidic chip channel identification method of the present application, and will not be described again here.

以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined in any way. To simplify the description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, all possible combinations should be used. It is considered to be within the scope of this manual.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-described embodiments only express several implementation modes of the present application, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the invention patent. It should be noted that, for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all fall within the protection scope of the present application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims (10)

1. A microfluidic chip channel identification method, the method comprising:
acquiring an image of a microfluidic chip acquired by an imaging sensor;
preprocessing an image of a microfluidic chip to obtain a first image, wherein the preprocessing comprises image enhancement, image binarization and small target removal;
sliding on the first image by using a sliding window with a preset size, and storing the central coordinate of the sliding window meeting a preset condition as a first target point to a target coordinate list, wherein the preset condition is a coordinate point of a target pixel value in the sliding window;
judging whether all first target points in the target coordinate list are in a micro-fluidic chip channel or not;
performing water-flooding filling treatment by taking a first target point in a chip channel as a seed point to obtain an image mask of a channel image in the microfluidic chip image, wherein the gray value of the seed point subjected to water-flooding filling treatment is a target pixel value;
and cutting out the image of the microfluidic chip by using the image mask to obtain a target image only containing channels of the microfluidic chip.
2. The method of claim 1, wherein the step of preprocessing the image of the microfluidic chip to obtain the first image comprises:
performing image enhancement on the image of the microfluidic chip by using an MSRCP algorithm developed based on a retinex algorithm to obtain a second image;
performing binarization processing on the second image based on a self-adaptive equalization algorithm to obtain a third image, wherein the gray value of the outline part of the microfluidic chip channel in the microfluidic chip image is set as a target pixel value during the binarization processing;
and carrying out background impurity removal processing on the third image based on a small target removal algorithm to obtain a first image, wherein the number of the connected areas with the whole pixel values not larger than a preset threshold value is removed during the background impurity removal processing.
3. The method of claim 1, wherein the step of determining whether all the first target points in the target coordinate list are within the microfluidic chip channel comprises:
checking all first target points in a target coordinate list, wherein the checking comprises taking the first target point as a center, transmitting line segments with lengths not more than the minimum value of the length and the width of a sliding window in four directions, namely, up, down, left and right, and determining the intersection point of the line segments and the contour part of a microfluidic chip channel in a first image;
and if the line segments in the up-down direction or the left-right direction have intersection points at the same time and the absolute value of the difference between the intersection points of the two sides of the line segments in the up-down direction or the left-right direction is smaller than a preset difference value, determining that the first target point is in the microfluidic chip channel.
4. The method according to claim 1, characterized in that: the preset size is set to 16 times the size of the first image size.
5. A microfluidic chip channel identification device, the device comprising:
the acquisition module is used for acquiring the image of the microfluidic chip acquired by the imaging sensor;
the image preprocessing module is used for preprocessing the image of the microfluidic chip to obtain a first image, wherein the preprocessing comprises image enhancement, image binarization and small target removal;
the sliding window processing module is used for sliding on the first image by using a sliding window with a preset size, and storing the central coordinate of the sliding window meeting the preset condition as a first target point to a target coordinate list, wherein the preset condition is a coordinate point of a target pixel value in the sliding window;
the judging module is used for judging whether all the first target points in the target coordinate list are in the microfluidic chip channel or not;
the device comprises a water-flooding filling processing module, a first target point processing module and a second target point processing module, wherein the water-flooding filling processing module is used for performing water-flooding filling processing by taking the first target point in a chip channel as a seed point to obtain an image mask of a channel image in a microfluidic chip image, and the gray value of the seed point subjected to water-flooding filling processing is a target pixel value;
and the clipping module is used for clipping the image of the microfluidic chip by using the image mask to obtain a target image only containing channels of the microfluidic chip.
6. The apparatus according to claim 5, wherein the image preprocessing module is specifically configured to:
performing image enhancement on the image of the microfluidic chip based on an MSRCP algorithm developed by a retine microfluidic chip channel recognition algorithm to obtain a second image;
performing binarization processing on the second image based on a self-adaptive equalization algorithm to obtain a third image, wherein the gray value of the outline part of the microfluidic chip channel in the microfluidic chip image is set as a target pixel value during the binarization processing;
and carrying out background impurity removal processing on the third image based on a small target removal algorithm to obtain a first image, wherein the number of the connected areas with the whole pixel values not larger than a preset threshold value is removed during the background impurity removal processing.
7. The apparatus of claim 5, wherein the determining module is specifically configured to:
checking all first target points in a target coordinate list, wherein the checking comprises taking the first target point as a center, transmitting line segments with lengths not more than the minimum value of the length and the width of a sliding window in four directions, namely, up, down, left and right, and determining the intersection point of the line segments and the contour part of a microfluidic chip channel in a first image;
and if the line segments in the up-down direction or the left-right direction have intersection points at the same time and the absolute value of the difference between the intersection points of the two sides of the line segments in the up-down direction or the left-right direction is smaller than a preset difference value, determining that the first target point is in the microfluidic chip channel.
8. The apparatus according to claim 5, wherein: the preset size is set to 16 times the size of the first image size.
9. A microfluidic chip channel recognition device, characterized in that it comprises a processor, a memory, and a microfluidic chip channel recognition program stored on the memory and executable by the processor, wherein the microfluidic chip channel recognition program, when executed by the processor, implements the steps of the microfluidic chip channel recognition method according to any one of claims 1 to 4.
10. A computer readable storage medium, wherein a microfluidic chip channel recognition program is stored on the computer readable storage medium, wherein the microfluidic chip channel recognition program, when executed by a processor, implements the steps of the microfluidic chip channel recognition method according to any one of claims 1 to 4.
CN202311076319.8A 2023-08-24 2023-08-24 Microfluidic chip channel identification method, device, equipment and readable storage medium Pending CN117132813A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311076319.8A CN117132813A (en) 2023-08-24 2023-08-24 Microfluidic chip channel identification method, device, equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311076319.8A CN117132813A (en) 2023-08-24 2023-08-24 Microfluidic chip channel identification method, device, equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN117132813A true CN117132813A (en) 2023-11-28

Family

ID=88855867

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311076319.8A Pending CN117132813A (en) 2023-08-24 2023-08-24 Microfluidic chip channel identification method, device, equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN117132813A (en)

Similar Documents

Publication Publication Date Title
CA2848233C (en) Methods of chromogen separation-based image analysis
KR100889014B1 (en) Extraction of Snowfall Region Using Graph-based Approach
CN108577803A (en) Fundus image detection method, device and system based on machine learning
CN112215790A (en) KI67 index analysis method based on deep learning
CN116542975B (en) Defect classification method, device, equipment and medium for glass panel
CN108682008A (en) A kind of Leukocyte Image clarity evaluation method and device
CN113450383B (en) Quantitative analysis method, device, equipment and medium of immunochromatographic test paper
CN109716355B (en) Particle boundary identification
CN118115496B (en) Wafer defect detection method and device
JP2014533857A (en) Image processing
CN108845153A (en) A kind of particle analysis system and method
CN115018797A (en) Screen defect detection method, detection device, and computer-readable storage medium
CN117576121A (en) Automatic segmentation method, system, equipment and medium for microscope scanning area
CN119086573A (en) A visual inspection method and system for IC packaging substrate appearance defects
CN119048521B (en) Method, device and computer equipment for counting milk somatic cells
CN110458042B (en) Method for detecting number of probes in fluorescent CTC
CN117132813A (en) Microfluidic chip channel identification method, device, equipment and readable storage medium
CN114155179A (en) Light source defect detection method, device, equipment and storage medium
CN115100273B (en) An immunochromatographic test strip quantitative analysis system and detection method based on image processing
CN114511559B (en) Method, system and medium for multidimensional evaluation of the quality of stained nasal polyp pathological sections
CN113643245B (en) Method and device for measuring screen defects and computer readable storage medium
CN105869147A (en) Typoscope stray light recognition method
CN112465817B (en) Pavement crack detection method based on directional filter
CN114998096A (en) Method and system for detecting crack proportion in pavement image
CN118243695B (en) Pathological section quality judging method and system based on image processing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20240105

Address after: Room 610, 6th Floor, Research Institute Building, Design City Phase II, No. 1 Sanle Road North, Design City Neighborhood Committee, Beijiao Town, Shunde District, Foshan City, Guangdong Province, 528300

Applicant after: Guangdong Foshan Lianchuang Engineering Graduate School

Applicant after: Foshan Dingzhi Biotechnology Co.,Ltd.

Applicant after: GUANGDONG SHUNDE INDUSTRIAL DESIGN INSTITUTE (GUANGDONG SHUNDE INNOVATIVE DESIGN INSTITUTE)

Address before: Room 610, 6th Floor, Research Institute Building, Design City Phase II, No. 1 Sanle Road North, Design City Neighborhood Committee, Beijiao Town, Shunde District, Foshan City, Guangdong Province, 528300

Applicant before: Guangdong Foshan Lianchuang Engineering Graduate School

Applicant before: Foshan Dingzhi Biotechnology Co.,Ltd.

TA01 Transfer of patent application right