CN109117497B - Time optimization method for computer aided design layout of digital microfluidic biochip - Google Patents

Time optimization method for computer aided design layout of digital microfluidic biochip Download PDF

Info

Publication number
CN109117497B
CN109117497B CN201810664383.0A CN201810664383A CN109117497B CN 109117497 B CN109117497 B CN 109117497B CN 201810664383 A CN201810664383 A CN 201810664383A CN 109117497 B CN109117497 B CN 109117497B
Authority
CN
China
Prior art keywords
constraints
digital microfluidic
microfluidic biochip
chemical
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810664383.0A
Other languages
Chinese (zh)
Other versions
CN109117497A (en
Inventor
陈小岛
刘东波
王玥玮
万超伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China University of Geosciences
Original Assignee
China University of Geosciences
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China University of Geosciences filed Critical China University of Geosciences
Priority to CN201810664383.0A priority Critical patent/CN109117497B/en
Publication of CN109117497A publication Critical patent/CN109117497A/en
Application granted granted Critical
Publication of CN109117497B publication Critical patent/CN109117497B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/30Circuit design
    • G06F30/39Circuit design at the physical level
    • G06F30/392Floor-planning or layout, e.g. partitioning or placement

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Architecture (AREA)
  • Evolutionary Computation (AREA)
  • Geometry (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a time optimization method for computer-aided design layout of a digital microfluidic biochip, which comprises the following steps: establishing models of four constraint conditions including priority constraint, resource constraint, overlapping constraint and fluid constraint; establishing a target model of the total completion time of the chain biochemical reaction on the digital microfluidic biochip; solving an optimal solution of the target model of the completion time according to the models of the four constraint conditions based on a Markov decision; and controlling the implementation process of the biochemical reaction on the digital microfluidic biochip according to the optimal solution. The invention can minimize the time of biochemical reaction in the digital microfluidic biochip, and has the advantages of low cost, high precision and high efficiency.

Description

数字微流控生物芯片计算机辅助设计布局的时间优化方法Time-optimized method for computer-aided design layout of digital microfluidic biochip

技术领域technical field

本发明涉及数字微流控生物芯片计算机辅助设计领域,更具体地说,涉及一种数字微流控生物芯片计算机辅助设计布局的时间优化方法。The invention relates to the field of computer-aided design of digital microfluidic biochips, and more specifically relates to a time optimization method for computer-aided design layout of digital microfluidic biochips.

背景技术Background technique

首先介绍微流控生物芯片的物理设计。如图1所示,微流控生物芯片主要由电极板构成,通过电润湿电极驱动液滴进行移动、混合、反应和存储等操作,液滴中存储着生物化学实验所需要的相关试剂样本,所有液滴均夹在两层铟锡氧化物电极板中间。这里有两种不可重配置的资源分别是光学检测器和光学分配端口,光学检测器用来检测每个操作是否正常进行,作为一种特殊的资源,它的位置在制造阶段就被固定下来并且在整个物理设计中都无法移动,光学分配端口用来产生液滴。First, the physical design of the microfluidic biochip is introduced. As shown in Figure 1, the microfluidic biochip is mainly composed of electrode plates, and the droplets are driven by electrowetting electrodes to move, mix, react, and store. The droplets store relevant reagent samples required for biochemical experiments. , all droplets are sandwiched between two layers of indium tin oxide electrode plates. There are two non-reconfigurable resources here, optical detector and optical distribution port. The optical detector is used to detect whether each operation is running normally. As a special resource, its position is fixed during the manufacturing stage and in the There is no movement throughout the physical design, and an optical distribution port is used to generate the droplets.

随着科学的进步,生化实验也愈加复杂,传统的微流控生物芯片设计已经无法满足需求,但是通过计算机辅助设计的帮助,不仅解决了该问题,而且还具有低成本、高精度和高效率的优点。微流控生物芯片的计算机辅助设计主要由任务规划、布局和布线三部分组成,包括了时间和尺寸两个优化目标,计算机辅助设计通过建立一个3D模型来模拟微流控生物芯片的一系列实验过程,如图2所示,将生物芯片的物理平面作为x-y平面,时间t为z轴,每一个模块里面都包含了液滴,液滴在模块里进行相关操作,例如移动、混合、反应和存储等,模块的长度跟宽度代表该操作所需要空间大小,高度代表该操作所需要的时间。微流控生物芯片在一定的实验约束条件下进行生物化学反应,如何控制微流控生物芯片快速完成所有的生物化学反应是微流控生物芯片中一个研究方向,然后这一技术问题目前还没有得到很好的解决。With the advancement of science, biochemical experiments are becoming more and more complex. The traditional microfluidic biochip design can no longer meet the needs. However, with the help of computer-aided design, not only has this problem been solved, but it also has low cost, high precision and high efficiency. The advantages. The computer-aided design of microfluidic biochip is mainly composed of three parts: task planning, layout and wiring, including two optimization goals of time and size. Computer-aided design simulates a series of experiments of microfluidic biochip by establishing a 3D model. The process, as shown in Figure 2, takes the physical plane of the biochip as the x-y plane, and the time t as the z-axis. Each module contains droplets, and the droplets perform related operations in the modules, such as moving, mixing, reacting and For storage, etc., the length and width of the module represent the space required for the operation, and the height represents the time required for the operation. Microfluidic biochips perform biochemical reactions under certain experimental constraints. How to control microfluidic biochips to quickly complete all biochemical reactions is a research direction in microfluidic biochips. However, this technical problem has not yet been resolved. Get well resolved.

发明内容Contents of the invention

本发明要解决的技术问题在于,针对现有技术的上述在计算机辅助设计布局的微流控生物芯片中,如何快速完成所有的生物化学反应还没有得到有效解决的技术缺陷,提供一种数字微流控生物芯片计算机辅助设计布局的时间优化方法。The technical problem to be solved by the present invention is to provide a digital microfluidic biochip for the technical defect of how to quickly complete all biochemical reactions in the microfluidic biochip of the prior art that has not been effectively solved. A Time-Optimized Method for Computer-Aided Design Layout of Fluidic Biochips.

本发明解决其技术问题所采用的技术方案是:构造一种数字微流控生物芯片计算机辅助设计布局的时间优化方法,包含如下步骤:The technical solution adopted by the present invention to solve the technical problem is: to construct a time optimization method for computer-aided design layout of a digital microfluidic biochip, including the following steps:

S1、建立以下四个约束条件的模型:S1. Establish a model with the following four constraints:

1)优先约束条件:化学反应的优先顺序定义了数字微流控生物芯片设计期间的对于不同操作的执行顺序;1) Priority constraints: The priority order of chemical reactions defines the execution order of different operations during digital microfluidic biochip design;

2)资源约束条件:确保整个系列生物化学反应使用每种类型的化学药剂,均不超过其资源限制的上限;2) Resource constraints: ensure that the use of each type of chemical agent in the entire series of biochemical reactions does not exceed the upper limit of its resource constraints;

3)重叠约束条件:确保了系列生物化学反应在同一个时间点不会在同一个位置执行;3) Overlap constraints: ensure that a series of biochemical reactions will not be performed at the same location at the same time point;

4)流体约束条件:定义了数字微流控生物芯片液滴之间的最小间距;4) Fluid constraints: define the minimum distance between droplets of digital microfluidic biochip;

S2、建立连锁生物化学反应在数字微流控生物芯片上完成总时间的目标模型:S2. Establish the target model of the total time for chain biochemical reactions to complete on the digital microfluidic biochip:

Figure BDA0001707255960000021
Figure BDA0001707255960000021

其中,{o1,o2,…,on}代表实验的所有的操作集,n≥2,t(oi)代表每一个操作oi的执行时间;Among them, {o 1 ,o 2 ,…,o n } represent all the operation sets of the experiment, n≥2, t(o i ) represents the execution time of each operation o i ;

S3、基于马尔可夫决策,根据所述四个约束条件的模型求解所述完成时间的目标模型的最优解;S3. Based on the Markov decision, solve the optimal solution of the target model of the completion time according to the model of the four constraint conditions;

S4、根据所述最优解,控制数字微流控生物芯片上生物化学反应的实现过程。S4. According to the optimal solution, control the implementation process of the biochemical reaction on the digital microfluidic biochip.

优选地,在本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法中,所述优先约束条件的建模具体包括:Preferably, in the digital microfluidic biochip computer-aided design layout time optimization method of the present invention, the modeling of the priority constraints specifically includes:

针对一系列的连锁生物化学反应,根据反应物之间的相互依赖关系,建立有向图定义生物化学反应之间的约束关系,记为G={O,P},图G中的O,O两项参数定义如下:For a series of chain biochemical reactions, according to the interdependence between reactants, a directed graph is established to define the constraint relationship between biochemical reactions, which is recorded as G={O,P}, and O,O in graph G The two parameters are defined as follows:

O={o1,o2,…,on}:表示一系列的生物化学反应;O={o 1 ,o 2 ,…,o n }: represents a series of biochemical reactions;

P={p1,p2,…,pm}:表示两个化学反应之间的优先约束条件,m≥n。P={p 1 ,p 2 ,…,p m }: represents the priority constraints between two chemical reactions, m≥n.

优选地,在本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法中,资源约束条件的建模具体包括:Preferably, in the time optimization method of digital microfluidic biochip computer-aided design layout of the present invention, the modeling of resource constraints specifically includes:

定义化学反应的药剂a用量为ma,药剂a总量为Ma,资源约束条件的模型为:The amount of agent a used to define the chemical reaction is ma , the total amount of agent a is M a , and the model of resource constraints is:

Figure BDA0001707255960000031
Figure BDA0001707255960000031

优选地,在本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法中,重叠约束条件的建模具体包括:Preferably, in the digital microfluidic biochip computer-aided design layout time optimization method of the present invention, the modeling of overlapping constraints specifically includes:

定义一个Cx,y∈{0,1}:表示化学试剂是否可以存在于点(x,y),若Cx,y=1,表示该点可以放置化学试剂,将其视为一个空闲单元格;若Cx,y=0,表示该点已经被占用,不能再存在与当前不同的化学试剂;Define a C x,y ∈ {0,1}: indicates whether chemical reagents can exist at point (x,y), if C x,y = 1, it means that chemical reagents can be placed at this point, and it is regarded as a free unit grid; if C x, y = 0, it means that this point has been occupied, and there can no longer exist chemical reagents different from the current one;

重叠约束条件的模型为:The model for overlapping constraints is:

x,yCx,y(L)≤1,

Figure BDA0001707255960000032
所有的试剂L。∑ x,y C x,y (L)≤1,
Figure BDA0001707255960000032
All reagents L.

优选地,在本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法中,流体约束条件的建模具体包括:Preferably, in the time optimization method of digital microfluidic biochip computer-aided design layout of the present invention, the modeling of fluid constraints specifically includes:

将数字微流控生物芯片进行单元化,即将数字微流控生物芯片根据既定的工业尺寸标准分为若干个单元格,每个单元格的左下角为单元格的起点,每个单元格的坐标分别以其与起点单元格的相对位置计算,记为(x,y),在数字微流控生物芯片上,化学药剂以单元格为单位进行移动、留存、反应,以保证满足流体约束条件。The digital microfluidic biochip is unitized, that is, the digital microfluidic biochip is divided into several cells according to the established industrial size standard, the lower left corner of each cell is the starting point of the cell, and the coordinates of each cell Calculated by their relative position with the starting cell, denoted as (x, y), on the digital microfluidic biochip, the chemical agent moves, retains, and reacts in units of cells to ensure that the fluid constraints are met.

优选地,在本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法中,步骤S1中的流体约束条件中所述最小间距为芯片上的一个单元格。Preferably, in the time optimization method for computer-aided design layout of digital microfluidic biochips of the present invention, the minimum spacing in the fluid constraints in step S1 is one cell on the chip.

优选地,在本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法中,步骤S3具体包括:Preferably, in the method for time optimization of digital microfluidic biochip computer-aided design layout of the present invention, step S3 specifically includes:

建立拓扑关系图G={O,P};其中,拓扑关系图根据化学反应的依赖关系,产生有向边,图中的每一个节点即为一个化学反应;Establish a topological relationship graph G={O, P}; wherein, the topological relationship graph generates directed edges according to the dependencies of chemical reactions, and each node in the graph is a chemical reaction;

然后从拓扑关系图G中根据有向图的优先顺序进行搜索,判断是否存在还未进行和完成的化学反应;如果有,则从中选取预设个节点进行马尔可夫决策,并根据决策结果更新G,然后重新判断G中是否存在没有使用的节点,直至G中不存在没有使用的节点;Then search from the topological relationship graph G according to the priority order of the directed graph to determine whether there are chemical reactions that have not yet been carried out and completed; if so, select a preset node from it to make a Markov decision, and update it according to the decision result G, and then re-judge whether there are unused nodes in G until there are no unused nodes in G;

得出最终的G作为最优解。Get the final G as the optimal solution.

实施本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法,能够将数字微流控生物芯片中的生物化学反应的时间将至最低,还具有低成本、高精度和高效率的优点。Implementing the time optimization method for computer-aided design layout of digital microfluidic biochips of the present invention can minimize the time of biochemical reactions in digital microfluidic biochips, and also has the advantages of low cost, high precision and high efficiency .

附图说明Description of drawings

下面将结合附图及实施例对本发明作进一步说明,附图中:The present invention will be further described below in conjunction with accompanying drawing and embodiment, in the accompanying drawing:

图1是数字微流控生物芯片的物理设计;Figure 1 is the physical design of the digital microfluidic biochip;

图2是数字微流控生物芯片计算机辅助设计的3D模型;Fig. 2 is the 3D model of digital microfluidic biochip computer-aided design;

图3是数字微流控生物芯片计算机辅助设计布局的时间优化方法流程图;Fig. 3 is a flow chart of a time optimization method for computer-aided design layout of a digital microfluidic biochip;

图4是操作的拓扑关系图实例;Fig. 4 is the example of the topological relationship diagram of operation;

图5是资源约束实例;Figure 5 is an example of resource constraints;

图6是关于马尔可夫决策算法的一个简单实例;Fig. 6 is a simple example about the Markov decision algorithm;

图7是马尔可夫决策算法叠代过程;Fig. 7 is the iterative process of the Markov decision algorithm;

图8是基于马尔可夫决策求解最优解的流程图。Fig. 8 is a flow chart of finding an optimal solution based on Markov decision.

具体实施方式Detailed ways

为了对本发明的技术特征、目的和效果有更加清楚的理解,现对照附图详细说明本发明的具体实施方式。In order to have a clearer understanding of the technical features, purposes and effects of the present invention, the specific implementation manners of the present invention will now be described in detail with reference to the accompanying drawings.

参考图3,其为本发明的数字微流控生物芯片计算机辅助设计布局的时间优化方法流程图,本方法具体包括:With reference to Fig. 3, it is the flow chart of the time optimization method of digital microfluidic biochip computer-aided design layout of the present invention, and this method specifically comprises:

S1、建立优先约束、资源约束、不重叠约束、流体约束条件的模型:S1. Establish a model of priority constraints, resource constraints, non-overlapping constraints, and fluid constraints:

微流控生物芯片的每一个标准模拟实验均有自己参数设定,在输入文件中给定了该实验的尺寸上限和时间上限,例如参数设定Fixed:10 10 360,则表示该实验的尺寸上限为10*10,时间上限为360,每一个试剂或操作也给定了所占用的尺寸大小,在进行该实验的一系列反应过程中,所有的操作均不能超过该尺寸的边界,总的反应时间也不能超过时间上限。Each standard simulation experiment of a microfluidic biochip has its own parameter settings. The upper limit of the size and time of the experiment is given in the input file. For example, the parameter setting Fixed: 10 10 360 indicates the size of the experiment The upper limit is 10*10, and the upper limit of time is 360. Each reagent or operation is also given a size occupied. During a series of reactions in this experiment, all operations cannot exceed the boundary of this size. The reaction time cannot exceed the time limit.

在进行计算机辅助设计时,还需要考虑以下四种约束条件:When doing computer-aided design, the following four constraints need to be considered:

(1)优先约束。化学反应的优先顺序定义了数字微流控生物芯片设计期间的对于不同操作的执行顺序。在芯片的计算机辅助设计过程中,优先约束定义了所有操作的执行序列。针对一系列的连锁生物化学反应,根据反应物之间的相互依赖关系,建立有向图定义生物化学反应之间的约束关系,记为G={O,P},图G中的O,P两项参数定义如下:(1) Priority constraints. The prioritization of chemical reactions defines the execution order for different operations during digital microfluidic biochip design. During the computer-aided design of the chip, priority constraints define the execution sequence of all operations. For a series of chain biochemical reactions, according to the interdependence relationship between reactants, a directed graph is established to define the constraint relationship between biochemical reactions, which is recorded as G={O,P}, and O,P in graph G The two parameters are defined as follows:

O={o1,o2,…,on}:表示一系列的生物化学反应;O={o 1 ,o 2 ,…,o n }: represents a series of biochemical reactions;

P={p1,p2,…,pm}:表示两个化学反应之间的优先约束条件,m≥n。P={p 1 ,p 2 ,…,p m }: represents the priority constraints between two chemical reactions, m≥n.

如图4所示,操作的执行序列可以由一个基于时间的拓扑图来表示,每一个节点代表一个缓冲或者一个操作,t轴代表每个节点在何时执行。DsB代表缓冲,缓冲必须经过准备时间才能投入使用并进入下一步操作,DsR代表反应试剂,Mix代表混合操作,Dlt代表稀释操作,大部分的节点都必须在自己的前驱执行完之后才能执行,同时存在一部分节点没有前驱但是有准备时间。在图3中,只有得到Mix2和Mix3的产物,才能执行Dlt2,DsB1和DsB2混合的产物与DsR进行稀释操作,DsB3和DsB4混合的产物与DsB4和DsB5混合的产物进行稀释操作,才能得到最终的产物Opt。As shown in Figure 4, the execution sequence of operations can be represented by a time-based topology graph, each node represents a buffer or an operation, and the t-axis represents when each node is executed. DsB stands for buffering, buffering must pass the preparation time before it can be put into use and enter the next step of operation, DsR stands for reaction reagent, Mix stands for mixing operation, Dlt stands for dilution operation, most nodes can only be executed after their precursors are executed, and at the same time There are some nodes that have no predecessors but have preparation time. In Figure 3, Dlt2 can be performed only when Mix2 and Mix3 products are obtained. The product mixed with DsB1 and DsB2 can be diluted with DsR, and the product mixed with DsB3 and DsB4 can be diluted with the product mixed with DsB4 and DsB5 to obtain the final product. Product Opt.

(2)资源约束。确保整个系列生物化学反应使用每种类型的化学药剂,均不超过其资源限制的上限。资源分为不可重配置资源和可重配置资源,不可重配置资源包括光学检测器和光学分配端口。可重配置资源包括所有的缓冲、试剂和操作产物,资源约束限定了所有的可重配置资源在同一时间被多个操作使用时,不能超过该资源拥有量的上限。资源约束条件的建模具体包括:(2) Resource constraints. Ensure that the entire series of biochemical reactions uses each type of chemical agent within its resource limit. Resources are divided into non-reconfigurable resources and reconfigurable resources, and non-reconfigurable resources include optical detectors and optical distribution ports. Reconfigurable resources include all buffers, reagents, and operation products. Resource constraints limit that when all reconfigurable resources are used by multiple operations at the same time, they cannot exceed the upper limit of the resources. The modeling of resource constraints specifically includes:

定义化学反应的药剂a用量为ma,药剂a总量为Ma,资源约束条件的模型为:The amount of agent a used to define the chemical reaction is ma , the total amount of agent a is M a , and the model of resource constraints is:

Figure BDA0001707255960000061
Figure BDA0001707255960000061

如图5所示,这里采用了一个简单的2D图来解释,资源i在t时刻只有两份,但此时操作1、操作2和操作3均需要使用资源i,则只有其中的两种操作能够完成。As shown in Figure 5, a simple 2D diagram is used to explain here. There are only two copies of resource i at time t, but at this time operation 1, operation 2 and operation 3 all need to use resource i, so there are only two of them. able to complete.

(3)不重叠约束。不重叠约束确保了在同一时刻不会有两个及以上的操作在同一位置进行。重叠约束条件的建模具体包括:(3) Non-overlapping constraints. Non-overlapping constraints ensure that no two or more operations are performed at the same location at the same time. The modeling of overlapping constraints specifically includes:

定义一个Cx,y∈{0,1}:表示化学试剂是否可以存在于点(x,y),若Cx,y=1,表示该点可以放置化学试剂,将其视为一个空闲单元格;若Cx,y=0,表示该点已经被占用,不能再存在与当前不同的化学试剂;Define a C x,y ∈ {0,1}: indicates whether chemical reagents can exist at point (x,y), if C x,y = 1, it means that chemical reagents can be placed at this point, and it is regarded as a free unit grid; if C x, y = 0, it means that this point has been occupied, and there can no longer exist chemical reagents different from the current one;

重叠约束条件的模型为:The model for overlapping constraints is:

x,yCx,y(L)≤1,

Figure BDA0001707255960000062
所有的试剂L。∑ x,y C x,y (L)≤1,
Figure BDA0001707255960000062
All reagents L.

(4)流体约束。流体约束定义了在同一个模块中两个不反应的液滴之间的最小间距,所述最小间距为芯片上的一个单元格。流体约束条件的建模具体包括:(4) Fluid constraints. Fluidic constraints define the minimum distance, one cell on the chip, between two non-reactive droplets in the same module. The modeling of fluid constraints specifically includes:

将数字微流控生物芯片进行单元化,即将数字微流控生物芯片根据既定的工业尺寸标准分为若干个单元格,每个单元格的左下角为单元格的起点,每个单元格的坐标分别以其与起点单元格的相对位置计算,记为(x,y),在数字微流控生物芯片上,化学药剂以单元格为单位进行移动、留存、反应,以保证满足流体约束条件。The digital microfluidic biochip is unitized, that is, the digital microfluidic biochip is divided into several cells according to the established industrial size standard, the lower left corner of each cell is the starting point of the cell, and the coordinates of each cell Calculated by their relative position with the starting cell, denoted as (x, y), on the digital microfluidic biochip, the chemical agent moves, retains, and reacts in units of cells to ensure that the fluid constraints are met.

所有的操作都必须遵循以上约束条件。All operations must comply with the above constraints.

S2、建立连锁生物化学反应在数字微流控生物芯片上完成总时间的目标模型:S2. Establish the target model of the total time for chain biochemical reactions to complete on the digital microfluidic biochip:

Figure BDA0001707255960000071
Figure BDA0001707255960000071

其中,{o1,o2,…,on}代表实验的所有的操作集,n≥2,t(oi)代表每一个操作oi的执行时间;Among them, {o 1 ,o 2 ,…,o n } represent all the operation sets of the experiment, n≥2, t(o i ) represents the execution time of each operation o i ;

S3、基于马尔可夫决策,根据所述四个约束条件的模型求解所述完成时间的目标模型的最优解;S3. Based on the Markov decision, solve the optimal solution of the target model of the completion time according to the model of the four constraint conditions;

在概率论和统计学中,马尔可夫决策过程(英语:Markov Decision Processes,缩写为MDPs)提供了一个数学架构模型,用于面对部分随机,部分可由决策者控制的状态下,如何进行决策。马尔可夫决策过程是一个五元组{S,A,Pa(s,s′),Ra(s,s′),δ∈(0,1)},其中In probability theory and statistics, Markov decision processes (English: Markov Decision Processes, abbreviated as MDPs) provide a mathematical framework model for how to make decisions in a state that is partly random and partly controllable by the decision maker . A Markov decision process is a five-tuple {S,A,P a (s,s′),R a (s,s′),δ∈(0,1)}, where

(1)S={s0,s1,…,sn}是一个状态集;(1) S={s 0 ,s 1 ,…,s n } is a state set;

(2)A是一个动作集,As表示在状态s时可接受的动作;(2) A is an action set, and A s represents acceptable actions in state s;

(3)Ra(s,s′)表示状态s通过动作a转化成状态s′的概率;(3) R a (s, s′) represents the probability that state s is transformed into state s′ through action a;

(4)Ra(s,s′)表示状态s通过动作a转化成状态s′的奖励值,该值由奖励函数R计算得出;(4) R a (s, s′) represents the reward value of state s transformed into state s′ through action a, which is calculated by reward function R;

(5)δ是折扣因子,它用来表示未来的状态转化对现在奖励的影响。(5) δ is a discount factor, which is used to represent the impact of future state transitions on current rewards.

马尔可夫决策过程有一个特点就是它的每两个状态之间都是彼此条件独立的,下一个状态s′依赖于当前状态s。每一次的状态转化都会有一个奖励值通过奖励函数R计算出来,马尔可夫决策过程的核心问题就是找出累计奖励值最大的方案,π(s)用来存储该方案中状态s和动作。A feature of the Markov decision process is that each of its two states is conditionally independent of each other, and the next state s' depends on the current state s. Each state transition will have a reward value calculated by the reward function R. The core problem of the Markov decision process is to find the plan with the largest cumulative reward value. π(s) is used to store the state s and actions in the plan.

公式1展示了马尔可夫决策过程的工作流,π(s)表示从状态s开始的累计奖励值最大的方案,v(s)是累计奖励值,选中的动作和状态都由π(s)来决定。马尔可夫决策过程通过迭代的方式来得出方案π(s),在每一次迭代过程中,当状态处于s时,决策者可以选择所有可用的动作,经过某一动作反应之后状态s会随机转化成下一个状态s′,马尔可夫决策过程会计算所有状态转化的奖励值。同时,状态的每一次转化都会有自己的概率,在迭代过程中,奖励值会持续衰减,最后返回累计奖励值。当所有的计算结果都返回之后,马尔可夫决策过程将选取累计奖励值最大的方案。以下是π(s)和v(s)的定义:Equation 1 shows the workflow of the Markov decision process, π(s) represents the plan with the largest cumulative reward value starting from state s, v(s) is the cumulative reward value, and the selected action and state are determined by π(s) to decide. The Markov decision process obtains the scheme π(s) through iteration. During each iteration, when the state is in s, the decision maker can choose all available actions, and the state s will be randomly transformed after a certain action reaction. To the next state s′, the Markov decision process will calculate the reward value of all state transitions. At the same time, each transition of the state will have its own probability. During the iterative process, the reward value will continue to decay, and finally the accumulated reward value will be returned. When all calculation results are returned, the Markov decision process will choose the solution with the largest cumulative reward value. Here are the definitions of π(s) and v(s):

Figure BDA0001707255960000081
Figure BDA0001707255960000081

图6展示了一个马尔可夫决策过程的例子,途中共有4个状态、5个动作以及相应的概率和奖励值,假定s0为初始状态,它的只有一个可用的动作a0,s0可以通过动作a0转化成状态s1和状态s2,转化成状态s1的奖励值为0.6*2,转化成状态s2的奖励值为0.4*3。它们的奖励值均为1.2,但是前者的概率大回报小,后者的概率小回报大。然后马尔可夫决策过程进入下一次迭代,从状态s1或者状态s2开始。不难看出,图中共有四种方案能到达最终状态s3,计算比较四种方案得出最佳方案为(s0,a0,s2,a2,s3),如图7所示。Figure 6 shows an example of a Markov decision process. There are 4 states, 5 actions and corresponding probabilities and reward values on the way. Assuming s 0 is the initial state, it has only one available action a 0 , s 0 can Through action a 0 is transformed into state s 1 and state s 2 , the reward value of transforming into state s 1 is 0.6*2, and the reward value of transforming into state s 2 is 0.4*3. Their reward values are both 1.2, but the former has a large probability and a small reward, while the latter has a small probability and a large reward. Then the Markov decision process enters the next iteration, starting from state s1 or state s2 . It is not difficult to see that there are four schemes in the figure that can reach the final state s 3 , and the calculation and comparison of the four schemes shows that the best scheme is (s 0 , a 0 , s 2 , a 2 , s 3 ), as shown in Figure 7 .

参考图8,基于马尔可夫决策求解最优解的流程图。Referring to FIG. 8 , it is a flow chart of finding an optimal solution based on Markov decision.

首先导入数据,导入的数据包括约束条件、需要发生的化学反应的反应物、生成物、反应时间和完成反应需要的芯片空间、每种化学药品的总量、芯片总尺寸;First import the data, the imported data includes the constraints, the reactants and products of the chemical reactions that need to occur, the reaction time and the chip space required to complete the reaction, the total amount of each chemical, and the total size of the chip;

然后建立拓扑关系图G={O,P};拓扑关系图根据化学反应的依赖关系,产生有向边,图中的每一个节点即为一个化学反应;Then set up the topological relationship graph G={O, P}; the topological relationship graph generates directed edges according to the dependence of the chemical reactions, and each node in the graph is a chemical reaction;

然后从拓扑关系图G中根据有向图的优先顺序进行搜索,判断是否存在还未进行和完成的化学反应;如果有,则从中选取预设个节点进行马尔可夫决策,并根据决策结果更新G,然后重新判断G中是否存在没有使用的节点,直至G中不存在没有使用的节点;Then search from the topological relationship graph G according to the priority order of the directed graph to determine whether there are chemical reactions that have not yet been carried out and completed; if so, select a preset node from it to make a Markov decision, and update it according to the decision result G, and then re-judge whether there are unused nodes in G until there are no unused nodes in G;

得出最终的G作为最优解。Get the final G as the optimal solution.

S4、根据所述最优解,控制数字微流控生物芯片上生物化学反应的实现过程。S4. According to the optimal solution, control the implementation process of the biochemical reaction on the digital microfluidic biochip.

本发明基于马尔科夫决策过程,提出了一种数字微流控生物芯片计算机辅助设计布局的时间优化算法。我们将布局问题的输入表示为图G={O,P},G包含了实验的所有协议,O={o1,o2,…,on}(n≥2)代表该实验的操作集,P={p1,p2,…,pm}(n≥2)代表所有操作之间的优先约束条件,下面是反应总时间的目标函数:Based on the Markov decision-making process, the invention proposes a time optimization algorithm for computer-aided design layout of digital microfluidic biochips. We represent the input of the layout problem as a graph G={O,P}, G contains all the protocols of the experiment, O={o 1 ,o 2 ,…,o n }(n≥2) represents the operation set of the experiment , P={p 1 ,p 2 ,…,p m }(n≥2) represents the priority constraints among all operations, and the following is the objective function of the total reaction time:

Figure BDA0001707255960000091
Figure BDA0001707255960000091

s.t.s.t.

Figure BDA0001707255960000092
Figure BDA0001707255960000092

其中n代表操作总数,t(oi)代表每一个操作oi的执行时间,化学反应的药剂a用量为ma,药剂a总量为Ma,Cx,y∈{0,1}表示化学试剂是否可以存在于点(x,y),每个操作都被当成一个模块,模块投影到x-y平面就变成了一个矩形,每个矩形均的位置均由四个坐标确定。Among them, n represents the total number of operations, t(o i ) represents the execution time of each operation o i , the amount of agent a in the chemical reaction is m a , the total amount of agent a is M a , and C x,y ∈ {0,1} represents Whether the chemical reagent can exist at the point (x, y), each operation is regarded as a module, and the module becomes a rectangle when projected onto the xy plane, and the position of each rectangle is determined by four coordinates.

上面结合附图对本发明的实施例进行了描述,但是本发明并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本发明的启示下,在不脱离本发明宗旨和权利要求所保护的范围情况下,还可做出很多形式,这些均属于本发明的保护之内。Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive, and those of ordinary skill in the art will Under the enlightenment of the present invention, many forms can also be made without departing from the gist of the present invention and the protection scope of the claims, and these all belong to the protection of the present invention.

Claims (3)

1.一种数字微流控生物芯片计算机辅助设计布局的时间优化方法,其特征在于,包含如下步骤:1. A time optimization method for digital microfluidic biochip computer-aided design layout, characterized in that, comprising the steps: S1、建立以下四个约束条件的模型:S1. Establish a model with the following four constraints: 1)优先约束条件:化学反应的优先顺序定义了数字微流控生物芯片设计期间的对于不同操作的执行顺序;所述优先约束条件的建模具体包括:1) Priority constraints: The priority order of chemical reactions defines the execution order of different operations during the design of digital microfluidic biochips; the modeling of the priority constraints specifically includes: 针对一系列的连锁生物化学反应,根据反应物之间的相互依赖关系,建立有向图定义生物化学反应之间的约束关系,记为G={O,P},图G中的O,P两项参数定义如下:For a series of chain biochemical reactions, according to the interdependence relationship between reactants, a directed graph is established to define the constraint relationship between biochemical reactions, which is recorded as G={O,P}, and O,P in graph G The two parameters are defined as follows: O={o1,o2,…,on}:表示一系列的生物化学反应;O={o 1 ,o 2 ,…,o n }: represents a series of biochemical reactions; P={p1,p2,…,pm}:表示两个化学反应之间的优先约束条件,m≥n;P={p 1 ,p 2 ,…,p m }: Indicates the priority constraints between two chemical reactions, m≥n; 2)资源约束条件:确保整个系列生物化学反应使用每种类型的化学药剂,均不超过其资源限制的上限;资源约束条件的建模具体包括:2) Resource constraints: ensure that the use of each type of chemical agent in the entire series of biochemical reactions does not exceed the upper limit of its resource constraints; the modeling of resource constraints specifically includes: 定义化学反应的药剂a用量为ma,药剂a总量为Ma,资源约束条件的模型为:The amount of agent a used to define the chemical reaction is ma , the total amount of agent a is M a , and the model of resource constraints is:
Figure FDA0004016699350000011
Figure FDA0004016699350000011
3)重叠约束条件:确保了系列生物化学反应在同一个时间点不会在同一个位置执行;重叠约束条件的建模具体包括:3) Overlapping constraints: It ensures that a series of biochemical reactions will not be performed at the same location at the same time point; the modeling of overlapping constraints specifically includes: 定义一个Cx,y∈{0,1}:表示化学试剂是否可以存在于点(x,y),若Cx,y=1,表示该点可以放置化学试剂,将其视为一个空闲单元格;若Cx,y=0,表示该点已经被占用,不能再存在与当前不同的化学试剂;Define a C x,y ∈ {0,1}: indicates whether chemical reagents can exist at point (x,y), if C x,y = 1, it means that chemical reagents can be placed at this point, and it is regarded as a free unit grid; if C x, y = 0, it means that this point has been occupied, and there can no longer exist chemical reagents different from the current one; 重叠约束条件的模型为:The model for overlapping constraints is: x,yCx,y(L)≤1,
Figure FDA0004016699350000012
所有的试剂L;
x,y C x,y (L)≤1,
Figure FDA0004016699350000012
All reagents L;
4)流体约束条件:定义了数字微流控生物芯片液滴之间的最小间距;将数字微流控生物芯片进行单元化,即将数字微流控生物芯片根据既定的工业尺寸标准分为若干个单元格,每个单元格的左下角为单元格的起点,每个单元格的坐标分别以其与起点单元格的相对位置计算,记为(x,y),在数字微流控生物芯片上,化学药剂以单元格为单位进行移动、留存、反应,以保证满足流体约束条件;4) Fluid constraints: define the minimum spacing between droplets of digital microfluidic biochips; unitize digital microfluidic biochips, that is, divide digital microfluidic biochips into several parts according to established industrial size standards The cell, the lower left corner of each cell is the starting point of the cell, and the coordinates of each cell are calculated by its relative position with the starting cell, recorded as (x, y), on the digital microfluidic biochip , the chemical agent moves, retains, and reacts in units of cells to ensure that the fluid constraints are met; S2、建立连锁生物化学反应在数字微流控生物芯片上完成总时间的目标模型:S2. Establish the target model of the total time for chain biochemical reactions to complete on the digital microfluidic biochip:
Figure FDA0004016699350000021
Figure FDA0004016699350000021
其中,{o1,o2,…,on}代表实验的所有的操作集,n≥2,t(oi)代表每一个操作oi的执行时间;Among them, {o 1 ,o 2 ,…,o n } represent all the operation sets of the experiment, n≥2, t(o i ) represents the execution time of each operation o i ; S3、基于马尔可夫决策,根据所述四个约束条件的模型求解所述完成时间的目标模型的最优解;S3. Based on the Markov decision, solve the optimal solution of the target model of the completion time according to the model of the four constraint conditions; S4、根据所述最优解,控制数字微流控生物芯片上生物化学反应的实现过程。S4. According to the optimal solution, control the implementation process of the biochemical reaction on the digital microfluidic biochip.
2.根据权利要求1所述的数字微流控生物芯片计算机辅助设计布局的时间优化方法,其特征在于,步骤S3具体包括:2. The time optimization method of digital microfluidic biochip computer aided design layout according to claim 1, is characterized in that, step S3 specifically comprises: 建立拓扑关系图G={O,P};Establish a topological relationship graph G={O, P}; 其中,拓扑关系图根据化学反应的依赖关系,产生有向边,图中的每一个节点即为一个化学反应;Among them, the topological relationship graph generates directed edges according to the dependency relationship of chemical reactions, and each node in the graph is a chemical reaction; 然后从拓扑关系图G中根据有向图的优先顺序进行搜索,判断是否存在还未进行和完成的化学反应;如果有,则从中选取预设个节点进行马尔可夫决策,并根据决策结果更新G,然后重新判断G中是否存在没有使用的节点,直至G中不存在没有使用的节点;Then search from the topological relationship graph G according to the priority order of the directed graph to determine whether there are chemical reactions that have not yet been carried out and completed; if so, select a preset node from it to make a Markov decision, and update it according to the decision result G, and then re-judge whether there are unused nodes in G until there are no unused nodes in G; 得出最终的G作为最优解。Get the final G as the optimal solution. 3.根据权利要求1所述的数字微流控生物芯片计算机辅助设计布局的时间优化方法,其特征在于,步骤S1中的流体约束条件中所述最小间距为芯片上的一个单元格。3. The method for time optimization of digital microfluidic biochip computer-aided design layout according to claim 1, characterized in that the minimum spacing in the fluid constraints in step S1 is one cell on the chip.
CN201810664383.0A 2018-06-25 2018-06-25 Time optimization method for computer aided design layout of digital microfluidic biochip Active CN109117497B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810664383.0A CN109117497B (en) 2018-06-25 2018-06-25 Time optimization method for computer aided design layout of digital microfluidic biochip

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810664383.0A CN109117497B (en) 2018-06-25 2018-06-25 Time optimization method for computer aided design layout of digital microfluidic biochip

Publications (2)

Publication Number Publication Date
CN109117497A CN109117497A (en) 2019-01-01
CN109117497B true CN109117497B (en) 2023-03-31

Family

ID=64821958

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810664383.0A Active CN109117497B (en) 2018-06-25 2018-06-25 Time optimization method for computer aided design layout of digital microfluidic biochip

Country Status (1)

Country Link
CN (1) CN109117497B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112836397B (en) * 2021-03-30 2023-02-21 福州大学 Advanced integrated design method for memory minimization in continuous microfluidic biochip
CN115935900A (en) * 2022-12-14 2023-04-07 福州大学 Physical design method for fault-tolerant guidance under completely programmable valve array biochip

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106934173A (en) * 2017-03-24 2017-07-07 哈尔滨工业大学 Based on the digital microcurrent-controlled chip on-line testing method that TABU search is combined with Artificial Potential Field Method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI421495B (en) * 2009-10-30 2014-01-01 Univ Nat Cheng Kung Microfluidic chip

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106934173A (en) * 2017-03-24 2017-07-07 哈尔滨工业大学 Based on the digital microcurrent-controlled chip on-line testing method that TABU search is combined with Artificial Potential Field Method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
数字微流控生物芯片微液滴优化调度;章安良;《电子器件》;20080815(第04期);全文 *
数字微流控生物芯片的架构级综合算法研究;杨敬松等;《仪器仪表学报》;20090515(第05期);全文 *

Also Published As

Publication number Publication date
CN109117497A (en) 2019-01-01

Similar Documents

Publication Publication Date Title
Han et al. Multi-AGV path planning with double-path constraints by using an improved genetic algorithm
Helms et al. A framework for computational design synthesis based on graph-grammars and function-behavior-structure
Ren et al. Ms*: A new exact algorithm for multi-agent simultaneous multi-goal sequencing and path finding
CN111649758B (en) Path planning method based on reinforcement learning algorithm in dynamic environment
Wang et al. Control-fluidic codesign for paper-based digital microfluidic biochips
CN109117497B (en) Time optimization method for computer aided design layout of digital microfluidic biochip
De Peuter et al. Toward AI assistants that let designers design
Dhouib An optimal method for the shortest path problem: the Dhouib-Matrix-SPP (DM-SPP)
Acevedo-Chedid et al. Soft-computing approaches for rescheduling problems in a manufacturing industry
McGeoch et al. Milestones on the quantum utility highway: Quantum annealing case study
Yang et al. Computational optimization: An overview
CN111141920A (en) On-line fault detection method of digital microfluidic biochip based on reinforcement learning
Solimanpur et al. Minimising tool switching and indexing times by ant colony optimisation in automatic machining centres
Datta et al. Design optimization for programmable microfluidic devices integrating contamination removal and capacity-wastage-aware washing
Wan et al. A multi-objective-driven placement technique for digital microfluidic biochips
Anosike et al. Dynamic reconfiguration and simulation of manufacturing systems using agents
Bathla Different types of process involved in the information content product model
CN116261503A (en) Motion planning device, motion planning method, and motion planning program
Kleijn et al. A process algebra based verification of a production system
Moghadam et al. A hierarchical layout generation method for quantum circuits
CN110928253A (en) Dynamic weighting heuristic scheduling method of automatic manufacturing system
Neary Engineering AI systems and AI for engineering: compositionality and physics in learning
CN118567345B (en) Safety-priority mobile robot control method and system
Huang Matrix controller design and deadlock analysis of automated manufacturing systems. Part 1. Designing the matrix-based controller
Bos et al. Formalisation of a production system modelling language the operational semantics of χ core

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant