WO2023206204A1 - Method and apparatus for structure optimizition - Google Patents

Method and apparatus for structure optimizition Download PDF

Info

Publication number
WO2023206204A1
WO2023206204A1 PCT/CN2022/089786 CN2022089786W WO2023206204A1 WO 2023206204 A1 WO2023206204 A1 WO 2023206204A1 CN 2022089786 W CN2022089786 W CN 2022089786W WO 2023206204 A1 WO2023206204 A1 WO 2023206204A1
Authority
WO
WIPO (PCT)
Prior art keywords
structural parameters
sets
state variables
nbo
pdes
Prior art date
Application number
PCT/CN2022/089786
Other languages
French (fr)
Inventor
Jun Zhu
Ze CHENG
Songming LIU
Hang SU
Zhongkai HAO
Chengyang YING
Original Assignee
Robert Bosch Gmbh
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch Gmbh, Tsinghua University filed Critical Robert Bosch Gmbh
Priority to PCT/CN2022/089786 priority Critical patent/WO2023206204A1/en
Publication of WO2023206204A1 publication Critical patent/WO2023206204A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/11Complex mathematical operations for solving equations, e.g. nonlinear equations, general mathematical optimization problems
    • G06F17/13Differential equations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/10Geometric CAD
    • G06F30/15Vehicle, aircraft or watercraft design
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • G06F30/23Design optimisation, verification or simulation using finite element methods [FEM] or finite difference methods [FDM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • G06F30/27Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00Computing arrangements based on specific mathematical models
    • G06N7/01Probabilistic graphical models, e.g. probabilistic networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/04Constraint-based CAD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2113/00Details relating to the application field
    • G06F2113/08Fluids

Definitions

  • aspects of the present disclosure relate generally to artificial intelligence (AI) , and more particularly, to optimizing structure of an object.
  • AI artificial intelligence
  • the structure of an object influences the performance of the object.
  • the object may be the wing of an airplane, the truss of a house, the pipes in a reactor, or the like.
  • the shape of an airfoil influences the pressure and velocity of the airflow with respect to the airfoil while the pressure and velocity influencing the performance of the physical system of the airfoil.
  • the physical system can be described by partial differential equations (PDEs) .
  • PDEs partial differential equations
  • the state variables of the physical system such as the pressure and velocity can be obtained by solving the PDEs based on the structural parameters such as those describing the shape of the object.
  • this procedure may be referred to as structural optimization.
  • the structural optimization is applicable in many areas including scientific area, engineering area, industrial area or the like.
  • the shape of chemical catalyst pellets, the shape of auto parts or the like may be optimized through the structural optimization procedure before manufacturing.
  • the disclosure proposes a novel framework for structural optimization, by which the time consumption and computation requirement may be reduced while optimization performance may be guaranteed.
  • a computer implemented method for optimizing structure of an object comprises: receiving structural parameters by a neural boundary operator (NBO) , wherein the structural parameters are used to describe boundary shape of the object, and the NBO is trained to map structural parameters of boundary shapes of the object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object; generating state variables by the NBO from the structural parameters with a forward pass, wherein the state variables correspond to the solutions of the PDEs and are used to describe physical states of the physical system related to the object; calculating an optimization objective value based on the state variables; and updating the structural parameters of the object based on the optimization objective value.
  • NBO neural boundary operator
  • PDEs partial differential equations
  • NBO neural boundary operator
  • PDEs partial differential equations
  • the method comprises: sampling a first number of sets of structural parameters corresponding to the first number of boundary shapes of the object according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution; generating the first number of sets of state variables by using a numerical solver to solve the PDEs of the object based on the first number of sets of structural parameters; sampling a second number of sets of structural parameters corresponding to the second number of boundary shapes of the object according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the first number of sets of structural parameters; and generating the second number of sets of state variables by using the numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters, wherein the first number of sets of structural parameters, the corresponding first number of sets of state variables, the second number of sets of structural parameters, and the corresponding second number of sets of state variables are included in the training data set.
  • a computer system which comprises one or more processors and one or more storage devices storing computer-executable instructions that, when executed, cause the one or more processors to perform the operations of the method as mentioned above as well as to perform the operations of the method according to aspects of the disclosure.
  • there provides one or more computer readable storage media storing computer-executable instructions that, when executed, cause one or more processors to perform the operations of the method as mentioned above as well as to perform the operations of the method according to aspects of the disclosure.
  • a computer program product comprising computer-executable instructions that, when executed, cause one or more processors to perform the operations of the method as mentioned above as well as to perform the operations of the method according to aspects of the disclosure.
  • the efficiency of structural optimization can be improved dramatically while the bottleneck of solving PDEs being resolved.
  • the adaptive sampling framework to collect training data set for training the NBO, the training cost of NBO is reduced by taking advantage of a tradeoff between exploiting the priors of the structure of the object and exploring unknown structures.
  • Fig. 1 illustrates an exemplary framework for optimizing structure of an object according to aspects of the disclosure.
  • Fig. 2A illustrates an architecture of NBO according to aspects of the disclosure.
  • Fig. 2B illustrates an architecture of NBO according to aspects of the disclosure.
  • Fig. 3 illustrates an exemplary structural optimization of flow baffles according to aspects of the disclosure.
  • Fig. 4 illustrates an exemplary structural optimization of conductive-media interfaces according to aspects of the disclosure.
  • Fig. 5 illustrates an exemplary process for optimizing structure of an object according to aspects of the disclosure.
  • Fig. 6 illustrates an exemplary process for collecting a training data set for training NBO according to aspects of the disclosure.
  • Fig. 7 illustrates an exemplary computing system according to aspects of the disclosure.
  • Fig. 1 illustrates an exemplary framework for optimizing structure of an object according to aspects of the disclosure.
  • the object to be structurally optimized in the example shown in Fig. 1 is an airfoil.
  • the shape of the airfoil is presented by a boundary ⁇ , which is parameterized by structural parameters ⁇ .
  • the structural parameters ⁇ may be a set of control points which consist of splines representing the shape of the airfoil.
  • the structure to be optimized is the shape of the airfoil represented by splines with a set of control points ⁇ .
  • the label ⁇ denotes the problem domain or particularly denotes the domain of the physical system related to the airfoil.
  • the arrowed lines denote airflows on the airfoil.
  • the physical state of the airflow on the airfoil may be represented by state variables of the physical system related to the airfoil.
  • the label x denotes spatial coordinates in the domain ⁇ .
  • NS equations are well known physical equations that can be used to describe the three-dimensional motion of viscous fluid substances.
  • the NS equations are second-order nonlinear PDEs, and may be used to model the weather, ocean currents, heat conducting, air flow around an airfoil, water flow in a pipe or in a reactor and many other applications.
  • the PDEs of the NS equations for a physical system of an object may be formulated according to physical laws related to the physical system of the object.
  • the PDEs of the physical system of the airfoil may be established according to the related physical law as shown by label 140 of Fig. 1.
  • the PDEs are used to govern the optimization of the structure of the airfoil, they may be referred to as governing PDEs.
  • the formulation of the governing PDEs may be implemented with well-known physical knowledge, and other kinds of PDEs used to describe a physical system of an object may also be used as the governing PDEs in aspects of the disclosure.
  • the objective or goal of the structural optimization of the airfoil is to reach the desired pressure distribution p ref on the airfoil surface by changing the structural parameter ⁇ .
  • the objective function J may be formulated as shown by label 130, and the aim of the structural optimization is to minimize the objective function J, which is a functional of the pressure p.
  • the shape of the airfoil corresponding to the boundary ⁇ parameterized by structural parameters ⁇ may be iteratively optimized to minimize the objective function J, so as to reach the desired pressure distribution p ref on the airfoil surface.
  • the PDEs 140 need to solved to obtain the physical state variables such as the velocity u and pressure p, and then the objective function J may be evaluated based on the physical state variables such as the pressure p. Then the structural parameters ⁇ may be updated or optimized based on the calculated objective function J as shown by label 160.
  • existing numerical methods such as finite element methods (FEM) and finite volume methods (FVM) may be used to obtain the velocity u and pressure p by solving the PDEs 140.
  • FEM finite element methods
  • FVM finite volume methods
  • FEM are frequently used to model the behavior of the structure, since they are accurate and stable to a wide range of PDEs including some complicated nonlinear PDEs (e.g., NS equations) .
  • NS equations nonlinear PDEs
  • the FEM solvers are frustrated by the large computational overhead.
  • the FEM solvers need to generate a mesh of the structure of the object and solve a large system of equations from scratch, which is exceedingly slow for high dimensional problems.
  • a Neural Boundary Operator (NBO) 150 is employed in the structural optimization frame 100 to solve the PDEs 140 with various boundary shapes represented by structural parameters ⁇ .
  • the NBO may be implemented with a deep learning architecture for learning operators from the structural parameters of the various boundary shapes to the solutions of PDEs.
  • the NBO 150 has learned the latent operator which can generalize to the space of the structural parameter ⁇ , in other words, the NBO has learned the mappings between the structural parameters of boundary shapes of the object and the solutions of the PDEs.
  • the overall structure optimization is an iterative process, of which during each iteration, the PDEs can be solved efficiently via a forward pass of NBO, instead of calling on an expensive FEM solver. Therefore, by using the NBO 150, the solution process of the PDEs may be accelerated with orders of magnitude compared with existing PDE solvers, leading the structural optimization framework 100 to be much more efficient.
  • Fig. 2A and Fig. 2B each illustrates an architecture of NBO according to aspects of the disclosure.
  • the structural optimization problem may be represented by the following equation (1) :
  • denotes the structural parameters of the structure of the object to be optimized, which are also the parameters of the boundary shapes
  • denotes the space of ⁇ .
  • the structural parameters ⁇ is changing during the optimization of the structure but is within the design space ⁇ .
  • J is the objective function whose value measures how good a given structure is
  • ⁇ ° is an elementwise comparison.
  • F denotes a vector-valued operator to represent the PDEs
  • B i denotes a vector-valued operator to represent the equation of the ith boundary condition
  • ⁇ i denotes a domain on which the ith boundary condition is defined
  • denotes the domain of the physical system
  • the shape of the boundary ⁇ i ( ⁇ ) is parameterized by structural parameters ⁇ and all the boundaries ⁇ i ( ⁇ ) together correspond to the structure to be optimized.
  • v is the viscosity of the fluid
  • ⁇ F is the Frobenius norm.
  • the physical system includes a 2D channel ⁇ with fluid and an elliptical baffle.
  • the structural optimization goal is to minimize the energy dissipated by the fluid by changing the structural parameters ⁇ (i.e., the shape of the elliptical baffle) , with the constraint that the area of the elliptical baffle is 1.
  • i.e., the shape of the elliptical baffle
  • is the problem domain (i.e., the 2D channel)
  • ⁇ 1 and ⁇ 2 are the inlet and outlet of the channel, respectively
  • ⁇ 3 is the geometry of the elliptical baffle.
  • the boundary ⁇ 3 ( ⁇ 1 , ⁇ 2 ) is the structure to be optimized. Since the structure is changing during the optimization process, the equation (4) corresponds to PDEs with various boundary shapes. Furthermore, in equation (3) , the objective function J depends on the physical state variable u, which is defined by equation (4) . The physical state variable u may be obtained by solving the PDEs (4) . In the structural optimization process, the PDEs need to be solved simultaneously with the optimization of the structure. However, previous methods are too time-consuming for applications, since they cannot generalize to PDEs with various boundary shapes and have to solve the PDEs from scratch repetitively.
  • NBO may be used to address the above challenges by generalizing to PDEs with various boundary shapes and mapping the structural parameters ⁇ to the solution of the PDEs.
  • the NBO is a neural network to approximate the latent operator NBO takes the coordinate x and the parameters ⁇ as inputs.
  • the output is an approximation of the solution of the PDEs at x, i.e.,
  • the NBO 200A comprises a branch subnetwork 210A and a trunk subnetwork 220A.
  • the branch subnetwork 210A takes the structural parameter ⁇ as its input and outputs n p-dimensional vectors and the trunk subnetwork 220A takes the coordinate x as its input and outputs n p-dimensional vectors where n equals to the dimension of the state variable s, p is a hyperparameter.
  • the respective dot products between the n vectors and n vectors are taken as the prediction of the solution of the PDEs
  • the branch subnetwork 210A and the trunk subnetwork 220A may be implemented as fully-connected networks (FCNs) .
  • the NBO 200B comprises a branch subnetwork 210B, a trunk subnetwork 220B and a port subnetwork 240B.
  • the branch subnetwork 210B takes the structural parameter ⁇ as its input and outputs n p-dimensional vectors and the trunk subnetwork 220B takes the coordinate x as its input and outputs n p-dimensional vectors where n equals to the dimension of the state variable s, p is a hyperparameter.
  • the n vectors and n vectors are concatenated as shown at 230B, and then input into the port subnetwork 240, which outputs the prediction of the solution of the PDEs
  • the port subnetwork 240B is a micro neural network.
  • the branch subnetwork 210B, the trunk subnetwork 220B and the port subnetwork 240B may be implemented as fully-connected networks (FCNs) .
  • ⁇ ( ⁇ i , x ij ) ⁇ 1 ⁇ i ⁇ N, 1 ⁇ j ⁇ M ⁇ are firstly sampled according to a custom distribution in the space ⁇ .
  • structure parameter ⁇ i may be referred to a set of structure parameter ⁇ i for sake of easy description and understanding.
  • a numerical solver such as the FEM solver is utilized to solve the corresponding PDEs to obtain the solutions ⁇ G ( ⁇ i ) (x ij ) ⁇ .
  • a data set ⁇ ( ⁇ i , x ij , G ( ⁇ i ) (x ij ) ) ⁇ can be constructed as the training and testing samples.
  • the NBO may be trained with the training data set.
  • the training objective for the NBO as shown in the following equation (5) may be employed:
  • w are the neural network weights, i.e., the parameters of the NBO, and is the space of neural network weights
  • G ( ⁇ ) (x) is the ground truth and is the prediction of the NBO model.
  • the distribution of the training data may significantly affect the performance of the structural optimization.
  • uniform sampling is inefficient since it is not focusing on those structures with good performance. Therefore, in another embodiment, the instances of the structural parameters of the training data are sampled according to a custom distribution so as to sample those structures with good performance.
  • equation (6) shows the density function of
  • the objective J ( ⁇ , s) (abbreviated as J ( ⁇ ) hereinafter) may be chosen as the prior, guiding the NBO to fit better around potential minimums of the objective function.
  • the exploitation (empirical prior) and the exploration (space filling) can be balanced.
  • the distribution of p ( ⁇ ) may be defined as shown in the following equation (7) in order for the balance of exploitation and exploration:
  • an estimator of the objective function J ( ⁇ ) may be utilized in an embodiment.
  • the estimator may be implemented as a linear model where w denotes the parameters or weights of the estimator It is appreciated that the estimator may be implemented as a non-linear model in another example. Assuming that the structural parameter space ⁇ is bounded (i.e., ) , can be defined on [-d, d] q and be normalized to get p ( ⁇ ) as shown in the following equation (8) :
  • the distribution p ( ⁇ ) can be determined based on equation (7) .
  • the distribution p ( ⁇ ) can be determined based on equation (8) or based on equations (8) and (9) .
  • the distribution p ( ⁇ ) can be determined based on equation (7) by taking as p ( ⁇ ) . It is appreciated that there may be other ways for implementing the custom sampling of structural parameter instances ⁇ i as defined in equation (7) .
  • ⁇ ) it may be determined with the well-known adaptive mesh refinement (AMR) technique.
  • the AMR uses a set of refinement criteria based on the local field, slope, or curvature of the variables to generate and actively adapt the mesh in each zone of a structure, which can improve the utilization of the nodes and reduce the computational cost in consequence.
  • the AMR technique is used to generate the mesh of the structure and the nodes of the mesh are set as corresponding coordinate samples
  • the NBO can generalize to various boundary shapes and thus can estimate the solutions of the PDEs with a forward pass in each iteration of structural optimization, avoiding the expensive solving process of PDEs.
  • the overall approach contains two stages. The first stage is collecting the dataset and training NBO. The second stage is to employ NBO to estimate the solutions of the PDEs in structural optimization. In the second stage, note that it may require NBO, which is an NN model, to make predictions on multiple points to evaluate the objective function J, especially when it has an integral term as shown in equation (3) for example, this provides a chance for GPU parallel acceleration.
  • Fig. 3 is a schematic diagram illustrating the structural optimization of Flow Baffles according to aspects of the disclosure.
  • ⁇ 2 to ⁇ 5 located in corresponding grids are the flow baffles to be optimized.
  • the goal of the structural optimization is to optimize the shape and position of the baffles ⁇ 2 to ⁇ 5 so as to obtain an even distribution of fluid flow at the outlet ⁇ 1, right with the little energy dissipated by the fluid.
  • the objective function of the structural optimization may be formulated based on fluid mechanics as shown in the following equation (10) :
  • the governing PDEs describing the physical system related to the flow baffles may be formulated according to physical laws, for example, the PDEs may be NS equations as shown in the following equation (11) :
  • p is the pressure
  • the constraints W ( ⁇ ) can be defined to confine each of ⁇ 2 to ⁇ 5 within its grid as shown in Fig. 3.
  • a mapping of the structural parameter can be made: where and minDist is the shortest distance from ith circle to the edge of the corresponding grid as shown in Fig. 3.
  • the allowable values of each dimension of ⁇ ′ are in a closed interval and the allowable parameters can be normalized to [-3, 3] 12 , where the superscript means 12 dimensions of the structural parameters.
  • the training of the NBO model is then performed on this mapped space, which is a normalized structural space of the original structural space.
  • the Adam algorithm may be utilized to optimize the structure of the baffles with NBO providing forward predictions of the PDEs as well as backward calculations of derivatives.
  • the number of iterations of optimizing the structure ⁇ is 200, the learning rate is 0.1.
  • the loss function is defined as
  • ⁇ absSum stands for the sum of absolute values of all elements of a vector.
  • a training data set for training the NBO model is generated.
  • the NBO may have the structure as shown in Fig. 2A or 2B. It is appreciated that the NBO may also have other structure.
  • N 5000, which means 5000 structure instances are included in the data set.
  • N 1 100.
  • the well-known FEM solver is used to generate the corresponding meshes for the structural instances as well as the values of the state variables ⁇ G ( ⁇ i ) (x ij ) ⁇ 1 ⁇ i ⁇ N 1 , 1 ⁇ j ⁇ M ⁇ according to the PDEs (11) , where the coordinate x ij corresponds to the node of the mesh, M is the number of nodes of the mesh, M may be a variable value related to the specific structure ⁇ i .
  • the estimator of the objective function (10) may be trained based on
  • the rest structural instances may be sampled according to the distribution defined in equation (7) with J replaced by For example, Markov Chain Monte Carlo (MCMC) method may be used to sample the rest 4900 structural instances according to the distribution defined in equation (7) .
  • MCMC Markov Chain Monte Carlo
  • the FEM solver is used to generate the corresponding meshes for the structural instances as well as the values of the state variables ⁇ G ( ⁇ i ) (x ij ) ⁇ N 1 +1 ⁇ i ⁇ N, 1 ⁇ j ⁇ M ⁇ .
  • the training data set for training the NBO is obtained, which is ⁇ ( ⁇ i , x ij , G ( ⁇ i ) (x ij ) ) ⁇ 1 ⁇ i ⁇ N, 1 ⁇ j ⁇ M ⁇ .
  • the NBO may be trained based on the training objective function (5) .
  • the trained NBO is used to estimate the state variables u and optional p, from which the objective J ( ⁇ ) is obtained according to equation (10) . Then the loss as shown in equation (13) is obtained, and the derivates of the loss with respect to ⁇ can be obtained accordingly. Finally the structural parameter ⁇ is updated based on the loss or its derivates in this structural optimization iteration.
  • the Adam algorithm may be utilized to update the structure ⁇ with the aim of minimizing J shown in equation (10) .
  • Fig. 4 is a schematic diagram illustrating the structural optimization of conductive-media interfaces according to aspects of the disclosure.
  • ⁇ 1 and ⁇ 2 are two conductive mediums with different thermal conductivity, governed by the PDEs as shown in the following equation (14) :
  • the structure to be optimized is the conductive-media interface ⁇ S represented by splines.
  • the leftmost and rightmost anchor points of the splines are fixed (marked as circular dots in Fig. 4)
  • the four middle anchor points are variable (marked as squared dots in Fig. 4) but within corresponding rectangular grids (marked as dotted lines in Fig. 4) .
  • the splines can be obtained by interpolation.
  • the goal of the structural optimization is to maximize the heat transfer through the interface ⁇ S by changing the structural parameters ⁇ .
  • the goal of the structural optimization may be described as shown in the following equation (15) :
  • the goal may be converted to a minimization problem by taking the objective function J as 1/h T (y) , as shown in the following equation (16) :
  • the constraints W ( ⁇ ) can be defined to confine each of anchor points within its grid as shown in Fig. 4.
  • the allowable parameters can be normalized to [-3, 3] 8 , where the superscript means 8 dimensions of the structural parameters.
  • the training of the NBO model is then performed on this mapped space, which is a normalized structural space of the original structural space.
  • the Adam algorithm may be utilized to optimize the structure of the interface with NBO providing forward predictions of the PDEs as well as backward calculations of derivatives.
  • the number of iterations of optimizing the structure ⁇ is 200, the learning rate is 0.1.
  • the loss function is defined as
  • ⁇ absSum stands for the sum of absolute values of all elements of a vector.
  • a training data set for training the NBO model is generated.
  • the NBO may have the structure as shown in Fig. 2A or 2B. It is appreciated that the NBO may also have other structure.
  • N 2000
  • N 1 100
  • the well-known FEM solver with AMR function is used to generate the corresponding meshes for the structural instances as well as the values of the state variables ⁇ G ( ⁇ i ) (x ij ) ⁇ 1 ⁇ i ⁇ N 1 , 1 ⁇ j ⁇ M ⁇ according to the PDEs (14) , where the coordinate x ij corresponds to the node of the mesh, M is the number of nodes of the mesh, M may be a variable value related to the specific structure ⁇ i .
  • the estimator of the objective function (16) may be trained based on
  • the rest structural instances may be sampled according to the distribution defined in equation (7) with J replaced by For example, Markov Chain Monte Carlo (MCMC) method may be used to sample the rest 1900 structural instances according to the distribution defined in equation (7) .
  • MCMC Markov Chain Monte Carlo
  • the FEM solver is used to generate the corresponding meshes for the structural instances as well as the values of the state variables ⁇ G ( ⁇ i ) (x ij ) ⁇ N 1 +1 ⁇ i ⁇ N, 1 ⁇ j ⁇ M ⁇ .
  • the training data set for training the NBO is obtained, which is ⁇ ( ⁇ i , x ij , G ( ⁇ i ) (x ij ) ) ⁇ 1 ⁇ i ⁇ N, 1 ⁇ j ⁇ M ⁇ .
  • the NBO may be trained based on the training objective function (5) .
  • the trained NBO is used to estimate the state variables y i , from which the objective J ( ⁇ ) is obtained according to equation (16) . Then the loss as shown in equation (18) is obtained, and the derivates of the loss with respect to ⁇ can be obtained accordingly.
  • the structural parameter ⁇ is updated based on the loss or its derivates in this structural optimization iteration.
  • the Adam algorithm may be utilized to update the structure ⁇ with the aim of minimizing J shown in equation (16) .
  • the structural optimization framework proposed in the disclosure is applicable to optimize the structure of any suitable object in addition to the specific objects exampled in Figs. 3 and 4.
  • the object to be structural optimized may be a part of a vehicle such as the car hood, a part of a plane such as the wine of the plane, a part of a rocket such as the rocket shall, fuel cell bipolar plate, pines of a reactor, or any suitable part of any suitable device.
  • Fig. 5 illustrates an exemplary process for optimizing structure of an object according to aspects of the disclosure. It is appreciated that the process may be implemented with computers or processors.
  • structural parameters are received by a neural boundary operator (NBO) , wherein the structural parameters are used to describe boundary shape of the object, and the NBO is trained to map structural parameters of various boundary shapes of the object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object.
  • PDEs partial differential equations
  • the structural parameters may also include other structural related parameters such as information related to materials or the like, in addition to those describing the boundary shape.
  • state variables are generated by the NBO from the structural parameters with a forward pass, wherein the state variables correspond to the solutions of the PDEs and are used to describe physical states of the physical system related to the object.
  • an optimization objective value is calculated based on the state variables. It is appreciated that the optimization objective value may be calculated based on the state variables and the structural parameters.
  • the structural parameters of the object are updated based on the optimization objective value.
  • the processes at blocks 510 to 540 are repeated by taking the updated structural parameters obtained in last loop at block 540 as the structural parameters in current loop at block 510.
  • the NBO comprises a branch network and a trunk network
  • the branch network takes the structural parameters as its input and outputs a first set of vectors
  • the trunk network takes coordinates of the object as its input and outputs a second set of vectors, wherein respective dot products between the first set of vectors and the second set of vectors are taken as the state variables.
  • the branch network and the trunk network are full connection networks.
  • the NBO comprises a branch network, a trunk network and a port network
  • the branch network takes the structural parameters as its input and outputs a first set of vectors
  • the trunk network takes coordinates of the object as its input and outputs a second set of vectors
  • the port network takes the first set of vectors and the second set of vectors as input and outputs the state variables.
  • the branch network, the trunk network and the port network are full connection networks.
  • the process 500 further comprises collecting a training data set for training the NBO, wherein the training data set comprises a first number of sets of structural parameters corresponding to a first number of boundary shapes of the object and a first number of sets of state variables corresponding to the first number of sets of structural parameters, wherein the first number is the size of the training data set.
  • the NBO is trained based on the training data set. It is appreciated that the first number of sets of structural parameters correspond to the structural instances as detailed above, where one set of structural parameters correspond to one structural instance ⁇ i .
  • the first number of sets of state variables correspond to the state variables ⁇ G ( ⁇ i ) (x ij ) ⁇ 1 ⁇ i ⁇ N, 1 ⁇ j ⁇ M ⁇ of the structural instances as detailed above, where one set of state variables correspond to the state variables ⁇ G ( ⁇ i ) (x ij ) ⁇ 1 ⁇ j ⁇ M ⁇ of one structural instance ⁇ i .
  • the collecting the training data set further comprises: initially sampling a second number of sets of structural parameters corresponding to a second number of boundary shapes of the object according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution; generating a second number of sets of state variables by using a numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters; sampling a third number of sets of structural parameters corresponding to a third number of boundary shapes of the object according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the second number of sets of structural parameters; and generating a third number of sets of state variables by using the numerical solver to solve the PDEs of the object based on the third number of sets of structural parameters, wherein the first number of sets of structural parameters consist of the second number of sets of structural parameters and the third number of sets of structural parameters, the first number of sets of state variables consist of the second number of sets of state variables and the third number of sets of state variables.
  • the second distribution is determined based further on the optimization objective value of unsampled structural parameters of the object.
  • the optimization objective value of the unsampled structural parameters of the object is estimated by an estimator, wherein the estimator is trained based on the second number of sets of structural parameters and a second number of corresponding optimization objective values, wherein the second number of corresponding optimization objective values are obtained based on the second number of sets of state variables.
  • the second distribution p ( ⁇ ) is determined by means of the following equation: wherein J ( ⁇ ) denotes the optimization objective function of the unsampled structural parameters ⁇ , denotes a balance factor, S t denotes a set of ⁇ i sampled so far, ⁇ i - ⁇ 2 denotes l 2 norm.
  • the object is one of a fuel cell bipolar plate, a part of a car, a part of a plane, a part of a building, pipes of a reactor, flow baffles.
  • the structural parameters comprise at least one of position, radius, width, height, length, anchor points.
  • the state variables comprise at least one of velocity, pressure, temperature.
  • Fig. 6 illustrates an exemplary process for collecting a training data set for training a neural boundary operator (NBO) .
  • the NBO is trained to map structural parameters of boundary shapes of an object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object, wherein the solutions of PDEs correspond to state variables used to describe physical states of the physical system related to the object.
  • PDEs partial differential equations
  • a first number of sets of structural parameters corresponding to a first number of boundary shapes of the object are initially sampled according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution.
  • a first number of sets of state variables are generated by using a numerical solver to solve the PDEs of the object based on the first number of sets of structural parameters.
  • a second number of sets of structural parameters corresponding to a second number of boundary shapes of the object are sampled according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the first number of sets of structural parameters.
  • a second number of sets of state variables are generated by using the numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters.
  • the first number of sets of structural parameters, the corresponding first number of sets of state variables, the second number of sets of structural parameters, and the corresponding second number of sets of state variables are included in the training data set.
  • the second distribution is determined based further on the optimization objective value of unsampled structural parameters of the object.
  • the optimization objective value of the unsampled structural parameters of the object is estimated by an estimator, wherein the estimator is trained based on the first number of sets of structural parameters and a first number of corresponding optimization objective values, wherein the first number of corresponding optimization objective values are obtained based on the first number of sets of state variables.
  • the second distribution p ( ⁇ ) is determined by means of the following equation: wherein J ( ⁇ ) denotes the optimization objective function of the unsampled structural parameters ⁇ , denotes a balance factor, S t denotes a set of ⁇ i sampled so far, ⁇ i - ⁇ 2 denotes l 2 norm.
  • Fig. 7 illustrates an exemplary computing system according to aspects of the disclosure.
  • the computing system 700 may comprise at least one processor 710.
  • the computing system 700 may further comprise at least one storage device 720.
  • the storage device 720 may store computer-executable instructions that, when executed, cause the processor 710 to perform any operations according to the embodiments of the present disclosure as described in connection with Figs. 1-6.
  • the embodiments of the present disclosure may be embodied in a computer-readable medium such as non-transitory computer-readable medium.
  • the non-transitory computer-readable medium may comprise instructions that, when executed, cause one or more processors to perform any operations according to the embodiments of the present disclosure as described in connection with Figs. 1-6.
  • inventions of the present disclosure may be embodied in a computer program product comprising computer-executable instructions that, when executed, cause one or more processors to perform any operations according to the embodiments of the present disclosure as described in connection with Figs. 1-6.
  • modules in the apparatuses described above may be implemented in various approaches. These modules may be implemented as hardware, software, or a combination thereof. Moreover, any of these modules may be further functionally divided into sub-modules or combined together.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Data Mining & Analysis (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Algebra (AREA)
  • Biophysics (AREA)
  • Databases & Information Systems (AREA)
  • Operations Research (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Automation & Control Theory (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A computer implemented method for optimizing structure of an object. The method comprises receiving structural parameters by a neural boundary operator (NBO), wherein the structural parameters are used to describe boundary shape of the object, and the NBO is trained to map structural parameters of boundary shapes of the object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object; generating state variables by the NBO from the structural parameters, wherein the state variables correspond to the solutions of the PDEs and are used to describe physical states of the physical system related to the object; calculating an optimization objective value based on the state variables; and updating the structural parameters based on the optimization objective value.

Description

METHOD AND APPARATUS FOR STRUCTURE OPTIMIZITION FIELD
Aspects of the present disclosure relate generally to artificial intelligence (AI) , and more particularly, to optimizing structure of an object.
BACKGROUND
The structure of an object, such as its shape, size, or distribution of materials, influences the performance of the object. Examples of the object may be the wing of an airplane, the truss of a house, the pipes in a reactor, or the like. For example, the shape of an airfoil influences the pressure and velocity of the airflow with respect to the airfoil while the pressure and velocity influencing the performance of the physical system of the airfoil. The physical system can be described by partial differential equations (PDEs) . The state variables of the physical system such as the pressure and velocity can be obtained by solving the PDEs based on the structural parameters such as those describing the shape of the object.
It is desirable to design the structure of an object so as to improve its performance, this procedure may be referred to as structural optimization. The structural optimization is applicable in many areas including scientific area, engineering area, industrial area or the like. For example, the shape of chemical catalyst pellets, the shape of auto parts or the like may be optimized through the structural optimization procedure before manufacturing.
Since most physical systems are described by partial differential equations (PDEs) , structural optimization is typically carried out with the governing PDEs. This can be time-consuming because of the need to solve PDEs at each iteration of the optimization.
SUMMARY
In order to improve the efficiency of the structural optimization, the disclosure proposes a novel framework for structural optimization, by which the time consumption and computation requirement may be reduced while optimization performance may be guaranteed.
According to an embodiment, there provides a computer implemented method for optimizing structure of an object. The method comprises: receiving structural parameters by a neural boundary operator (NBO) , wherein the structural parameters are used to describe boundary shape of the object, and the NBO is trained to map structural parameters of boundary shapes of the object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object; generating state variables by the NBO from the structural parameters with a forward pass, wherein the state variables correspond to the solutions of the PDEs and are used to describe physical states of the physical system  related to the object; calculating an optimization objective value based on the state variables; and updating the structural parameters of the object based on the optimization objective value.
According to an embodiment, there provides a method for collecting a training data set for training a neural boundary operator (NBO) , wherein the NBO is trained to map structural parameters of boundary shapes of an object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object, wherein the solutions of PDEs correspond to state variables used to describe physical states of the physical system related to the object. The method comprises: sampling a first number of sets of structural parameters corresponding to the first number of boundary shapes of the object according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution; generating the first number of sets of state variables by using a numerical solver to solve the PDEs of the object based on the first number of sets of structural parameters; sampling a second number of sets of structural parameters corresponding to the second number of boundary shapes of the object according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the first number of sets of structural parameters; and generating the second number of sets of state variables by using the numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters, wherein the first number of sets of structural parameters, the corresponding first number of sets of state variables, the second number of sets of structural parameters, and the corresponding second number of sets of state variables are included in the training data set.
According to an embodiment, there provides a computer system, which comprises one or more processors and one or more storage devices storing computer-executable instructions that, when executed, cause the one or more processors to perform the operations of the method as mentioned above as well as to perform the operations of the method according to aspects of the disclosure.
According to an embodiment, there provides one or more computer readable storage media storing computer-executable instructions that, when executed, cause one or more processors to perform the operations of the method as mentioned above as well as to perform the operations of the method according to aspects of the disclosure.
According to an embodiment, there provides a computer program product comprising computer-executable instructions that, when executed, cause one or more processors to perform the operations of the method as mentioned above as well as to perform the operations of the method according to aspects of the disclosure.
By using the NBO, which learns mappings between the structural parameters of variant boundary shapes of an object and the solutions of the PDEs, in the optimization framework, the efficiency of structural optimization can be improved  dramatically while the bottleneck of solving PDEs being resolved. Moreover, by using the adaptive sampling framework to collect training data set for training the NBO, the training cost of NBO is reduced by taking advantage of a tradeoff between exploiting the priors of the structure of the object and exploring unknown structures. Other advantages and enhancements are explained in the description hereafter.
BRIEF DESCRIPTION OF THE DRAWINGS
The disclosed aspects will hereinafter be described in connection with the appended drawings that are provided to illustrate and not to limit the disclosed aspects.
Fig. 1 illustrates an exemplary framework for optimizing structure of an object according to aspects of the disclosure.
Fig. 2A illustrates an architecture of NBO according to aspects of the disclosure.
Fig. 2B illustrates an architecture of NBO according to aspects of the disclosure.
Fig. 3 illustrates an exemplary structural optimization of flow baffles according to aspects of the disclosure.
Fig. 4 illustrates an exemplary structural optimization of conductive-media interfaces according to aspects of the disclosure.
Fig. 5 illustrates an exemplary process for optimizing structure of an object according to aspects of the disclosure.
Fig. 6 illustrates an exemplary process for collecting a training data set for training NBO according to aspects of the disclosure.
Fig. 7 illustrates an exemplary computing system according to aspects of the disclosure.
DETAILED DESCRIPTION
The present disclosure will now be discussed with reference to several example implementations. It is to be understood that these implementations are discussed only for enabling those skilled in the art to better understand and thus implement the embodiments of the present disclosure, rather than suggesting any limitations on the scope of the present disclosure.
Various embodiments will be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. References made to particular examples and embodiments are for illustrative purposes, and are not intended to limit the scope of the disclosure.
Fig. 1 illustrates an exemplary framework for optimizing structure of an object according to aspects of the disclosure.
The object to be structurally optimized in the example shown in Fig. 1 is  an airfoil. As shown in block 120 of Fig. 1, the shape of the airfoil is presented by a boundary γ, which is parameterized by structural parameters θ. In this example, the structural parameters θ may be a set of control points which consist of splines representing the shape of the airfoil. In other words, the structure to be optimized is the shape of the airfoil represented by splines with a set of control points θ. The label Ω denotes the problem domain or particularly denotes the domain of the physical system related to the airfoil.
As shown in block 110 of Fig. 1, the arrowed lines denote airflows on the airfoil. The physical state of the airflow on the airfoil may be represented by state variables of the physical system related to the airfoil. In this example, the state variables may be the velocity u=u (x) and the pressure p=p (x) . The label x denotes spatial coordinates in the domain Ω.
The velocity u=u (x) and the pressure p=p (x) may be characterized by nonlinear PDEs of Navier–Stokes (NS) equations, with the constraint of the shape of the airfoil represented by the boundary γ. It is appreciated that NS equations are well known physical equations that can be used to describe the three-dimensional motion of viscous fluid substances. The NS equations are second-order nonlinear PDEs, and may be used to model the weather, ocean currents, heat conducting, air flow around an airfoil, water flow in a pipe or in a reactor and many other applications. The PDEs of the NS equations for a physical system of an object may be formulated according to physical laws related to the physical system of the object. In the illustrated example, the PDEs of the physical system of the airfoil may be established according to the related physical law as shown by label 140 of Fig. 1. As the PDEs are used to govern the optimization of the structure of the airfoil, they may be referred to as governing PDEs. It is appreciated that the formulation of the governing PDEs may be implemented with well-known physical knowledge, and other kinds of PDEs used to describe a physical system of an object may also be used as the governing PDEs in aspects of the disclosure.
As shown by label 130 of Fig. 1, the objective or goal of the structural optimization of the airfoil is to reach the desired pressure distribution p ref on the airfoil surface by changing the structural parameter θ. The objective function J may be formulated as shown by label 130, and the aim of the structural optimization is to minimize the objective function J, which is a functional of the pressure p. The shape of the airfoil corresponding to the boundary γ parameterized by structural parameters θ may be iteratively optimized to minimize the objective function J, so as to reach the desired pressure distribution p ref on the airfoil surface.
In each loop of the structural optimization, the PDEs 140 need to solved to obtain the physical state variables such as the velocity u and pressure p, and then the objective function J may be evaluated based on the physical state variables such as the pressure p. Then the structural parameters θ may be updated or optimized based on the calculated objective function J as shown by label 160.
In an example, existing numerical methods such as finite element methods (FEM) and finite volume methods (FVM) may be used to obtain the velocity u and pressure p by solving the PDEs 140. For example, FEM are frequently used to model the behavior of the structure, since they are accurate and stable to a wide range of PDEs including some complicated nonlinear PDEs (e.g., NS equations) . Despite the accuracy and stability, the FEM solvers are frustrated by the large computational overhead. For each instance of the PDEs, the FEM solvers need to generate a mesh of the structure of the object and solve a large system of equations from scratch, which is exceedingly slow for high dimensional problems. For example, even for a medium-sized system, for example, a system represented with a 50 × 50 two-dimensional (2D) mesh, the numerical methods often require a few seconds to obtain the solutions of the PDEs. Since the solutions of PDEs are extremely sensitive to boundary conditions and such methods lack the ability to generalize to various boundary shapes, they require independently solving PDEs millions of times during the optimization process, incurring unbearable computational overhead and corresponding time consuming. Using the existing numerical PDE solvers such as FEM solvers and FVM solvers in the structural optimization frame 100 would lead to inefficiency of the structural optimization of the object.
In an embodiment, as illustrated in Fig. 1, a Neural Boundary Operator (NBO) 150 is employed in the structural optimization frame 100 to solve the PDEs 140 with various boundary shapes represented by structural parameters θ. The NBO may be implemented with a deep learning architecture for learning operators from the structural parameters of the various boundary shapes to the solutions of PDEs. In the illustrated example, the NBO 150 has learned the latent operator 
Figure PCTCN2022089786-appb-000001
which can generalize to the space of the structural parameter θ, in other words, the NBO has learned the mappings between the structural parameters of boundary shapes of the object and the solutions of the PDEs. As the NBO can effectively generalize across variant boundary shapes, the overall structure optimization is an iterative process, of which during each iteration, the PDEs can be solved efficiently via a forward pass of NBO, instead of calling on an expensive FEM solver. Therefore, by using the NBO 150, the solution process of the PDEs may be accelerated with orders of magnitude compared with existing PDE solvers, leading the structural optimization framework 100 to be much more efficient.
Fig. 2A and Fig. 2B each illustrates an architecture of NBO according to aspects of the disclosure.
The structural optimization problem may be represented by the following equation (1) :
Figure PCTCN2022089786-appb-000002
where θ denotes the structural parameters of the structure of the object to be optimized, which are also the parameters of the boundary shapes, Θ denotes the space  of θ. The structural parameters θ is changing during the optimization of the structure but is within the design space Θ. J is the objective function whose value measures how good a given structure is, W stands for the constraints on both the structural parameters θ and the state variable s = s (x) which denotes the state of the physical system, for example, velocity, pressure or the like, where x denotes spatial coordinates. And the symbol “≤°” is an elementwise comparison.
Since the state variables s are associated with the physical system of the object to be structurally optimized, it is characterized by the PDEs as shown in the following equation (2) :
Figure PCTCN2022089786-appb-000003
where F denotes a vector-valued operator to represent the PDEs, B i denotes a vector-valued operator to represent the equation of the ith boundary condition, γ i denotes a domain on which the ith boundary condition is defined, Ω denotes the domain of the physical system, the shape of the boundary γ i (θ) is parameterized by structural parameters θ and all the boundaries γ i (θ) together correspond to the structure to be optimized. For any given structural parameters θ, it may assume the PDEs have a unique solution s. Hence, an operator 
Figure PCTCN2022089786-appb-000004
can defined as G (θ) (x) = s (x) .
As an example, the problem of drag minimization of 2D fluid as shown in the following equation (3) may be considered:
Figure PCTCN2022089786-appb-000005
where v is the viscosity of the fluid, ∥·∥ F is the Frobenius norm. In this example, the physical system includes a 2D channel Ω with fluid and an elliptical baffle. Moreover, the structural parameters θ = (θ 1, θ 2) ∈ Θ = [0, 1]  2, where θ 1 and θ 2 are respectively corresponding to the width and height of the elliptical baffle. The state variable is s = (p, u) , where p = p (x) and u = u (x) are the pressure and the velocity of the fluid respectively. The structural optimization goal is to minimize the energy dissipated by the fluid by changing the structural parameters θ (i.e., the shape of the elliptical baffle) , with the constraint that the area of the elliptical baffle is 1. And the physical state variable s = (p, u) is characterized by the nonlinear PDEs of NS equations (4) :
Figure PCTCN2022089786-appb-000006
where Ω is the problem domain (i.e., the 2D channel) , γ 1 and γ 2 are the inlet and outlet of the channel, respectively, and γ 3 is the geometry of the elliptical baffle. It is appreciated that the PDEs (4) describing the physical system may be formulated according to the physical law of the physical system.
In the equation (4) , the boundary γ 3 (θ 1, θ 2) is the structure to be optimized. Since the structure is changing during the optimization process, the equation (4) corresponds to PDEs with various boundary shapes. Furthermore, in equation (3) , the objective function J depends on the physical state variable u, which is defined by equation (4) . The physical state variable u may be obtained by solving the PDEs (4) . In the structural optimization process, the PDEs need to be solved simultaneously with the optimization of the structure. However, previous methods are too time-consuming for applications, since they cannot generalize to PDEs with various boundary shapes and have to solve the PDEs from scratch repetitively.
NBO may be used to address the above challenges by generalizing to PDEs with various boundary shapes and mapping the structural parameters θ to the solution of the PDEs. The NBO is a neural network
Figure PCTCN2022089786-appb-000007
to approximate the latent operator 
Figure PCTCN2022089786-appb-000008
NBO takes the coordinate x and the parameters θ as inputs. The output is an approximation of the solution of the PDEs at x, i.e., 
Figure PCTCN2022089786-appb-000009
Figure PCTCN2022089786-appb-000010
In the embodiment shown in Fig. 2A, the NBO 200A comprises a branch subnetwork 210A and a trunk subnetwork 220A. The branch subnetwork 210A takes the structural parameter θ as its input and outputs n p-dimensional vectors
Figure PCTCN2022089786-appb-000011
and the trunk subnetwork 220A takes the coordinate x as its input and outputs n p-dimensional vectors
Figure PCTCN2022089786-appb-000012
where n equals to the dimension of the state variable s, p is a hyperparameter. As shown at 230A, the respective dot products between the n vectors
Figure PCTCN2022089786-appb-000013
and n vectors 
Figure PCTCN2022089786-appb-000014
are taken as the prediction of the solution of the PDEs
Figure PCTCN2022089786-appb-000015
The branch subnetwork 210A and the trunk subnetwork 220A may be implemented as fully-connected networks (FCNs) .
In the embodiment shown in Fig. 2B, the NBO 200B comprises a branch subnetwork 210B, a trunk subnetwork 220B and a port subnetwork 240B. The branch subnetwork 210B takes the structural parameter θ as its input and outputs n p-dimensional vectors
Figure PCTCN2022089786-appb-000016
and the trunk subnetwork 220B takes the coordinate x as its input and outputs n p-dimensional vectors
Figure PCTCN2022089786-appb-000017
Figure PCTCN2022089786-appb-000018
where n equals to the dimension of the state variable s, p is a hyperparameter. The n vectors
Figure PCTCN2022089786-appb-000019
and n vectors
Figure PCTCN2022089786-appb-000020
are concatenated as shown at 230B, and then input into the  port subnetwork 240, which outputs the prediction of the solution of the PDEs 
Figure PCTCN2022089786-appb-000021
The port subnetwork 240B is a micro neural network. Taking advantage of the potent nonlinear approximation ability of the port subnetwork 240B, the abstraction ability of the NBO 200B for high-level features may be further improved compared to the NBO 200A. The branch subnetwork 210B, the trunk subnetwork 220B and the port subnetwork 240B may be implemented as fully-connected networks (FCNs) .
In order to train the NBO which is the neural network
Figure PCTCN2022089786-appb-000022
for approximating the latent operator 
Figure PCTCN2022089786-appb-000023
instances of the structural parameters are firstly sampled, that is, { (θ i, x ij) ∣1≤i≤N, 1≤j≤M} are firstly sampled according to a custom distribution 
Figure PCTCN2022089786-appb-000024
in the space Θ×Ω. One instance of structure parameter θ i may be referred to a set of structure parameter θ i for sake of easy description and understanding. Then a numerical solver such as the FEM solver is utilized to solve the corresponding PDEs to obtain the solutions {G (θ i) (x ij) } . In this way, a data set { (θ i, x ij, G (θ i) (x ij) ) } can be constructed as the training and testing samples.
The NBO may be trained with the training data set. The training objective for the NBO as shown in the following equation (5) may be employed:
Figure PCTCN2022089786-appb-000025
where w are the neural network weights, i.e., the parameters of the NBO, and
Figure PCTCN2022089786-appb-000026
is the space of neural network weights, G (θ) (x) is the ground truth and
Figure PCTCN2022089786-appb-000027
is the prediction of the NBO model. Instead of approximating the solution of a specific instance of the PDEs, the training data are sampled in the structural parameter space Θ and the NBO is trained with these samples to learn the underlying operator 
Figure PCTCN2022089786-appb-000028
Figure PCTCN2022089786-appb-000029
In this way, for a new structure, it can take advantage of the generalizability of NBO to transfer to the solution of the corresponding PDEs without solving from scratch.
Since NBO is the key component in the overall structural optimization framework, the distribution
Figure PCTCN2022089786-appb-000030
of the training data may significantly affect the performance of the structural optimization. In an embodiment, 
Figure PCTCN2022089786-appb-000031
is the uniform distribution. However, uniform sampling is inefficient since it is not focusing on those structures with good performance. Therefore, in another embodiment, the instances of the structural parameters of the training data are sampled according to a custom distribution so as to sample those structures with good performance. The following equation (6) shows the density function of
Figure PCTCN2022089786-appb-000032
p (θ, x) =p (θ) p (x∣θ)                                             (6)
Since the structural optimizers are more likely to stay in the locations where the value of the objective function J is lower, which means a better structure, it is advantageous to sample those points with lower J values. The objective J (θ, s) (abbreviated as J (θ) hereinafter) may be chosen as the prior, guiding the NBO to fit  better around potential minimums of the objective function.
The exploitation (empirical prior) and the exploration (space filling) can be balanced. The distribution of p (θ) may be defined as shown in the following equation (7) in order for the balance of exploitation and exploration:
Figure PCTCN2022089786-appb-000033
where
Figure PCTCN2022089786-appb-000034
is the unnormalized density function, 
Figure PCTCN2022089786-appb-000035
is a balance factor, S t is a set of θ i already sampled so far, and ∥·∥ 2 is the l 2 norm.
Since the objective function J (θ) of the structural optimization does not have an analytic expression from θ to J, an estimator of the objective function J (θ) may be utilized in an embodiment. A small set of structural instances {θ i} may be firstly sampled according to a sampling distribution, which may be a uniform distribution. Then the FEM solver may be used to obtain corresponding solutions {G (θ i) =s i} of PDEs, which are used to evaluate the corresponding objective function {J (θ i, s i) } . Then the date set {θ i, J (θ i, s i) } can serve as training data of the estimator
Figure PCTCN2022089786-appb-000036
In an example, the estimator
Figure PCTCN2022089786-appb-000037
may be implemented as a linear model 
Figure PCTCN2022089786-appb-000038
where w denotes the parameters or weights of the estimator
Figure PCTCN2022089786-appb-000039
It is appreciated that the estimator
Figure PCTCN2022089786-appb-000040
may be implemented as a non-linear model in another example. Assuming that the structural parameter space Θ is bounded (i.e., 
Figure PCTCN2022089786-appb-000041
Figure PCTCN2022089786-appb-000042
) , 
Figure PCTCN2022089786-appb-000043
can be defined on [-d, d]  q and be normalized to get p (θ) as shown in the following equation (8) :
Figure PCTCN2022089786-appb-000044
The expression of the normalized coefficient
Figure PCTCN2022089786-appb-000045
may be given as shown in the following equation (9) :
Figure PCTCN2022089786-appb-000046
Where
Figure PCTCN2022089786-appb-000047
and erfi is the imaginary error function.
In an embodiment, the distribution p (θ) can be determined based on equation (7) . In another embodiment, the distribution p (θ) can be determined based on equation (8) or based on equations (8) and (9) . In another embodiment, the distribution p (θ) can be determined based on equation (7) by taking
Figure PCTCN2022089786-appb-000048
as p (θ) . It is appreciated that there may be other ways for implementing the custom sampling of structural parameter instances θ i as defined in equation (7) .
As for p (x | θ) , it may be determined with the well-known adaptive mesh refinement (AMR) technique. The AMR uses a set of refinement criteria based on the local field, slope, or curvature of the variables to generate and actively adapt the mesh in each zone of a structure, which can improve the utilization of the nodes and reduce  the computational cost in consequence. In an embodiment, given a structure instance θ i, the AMR technique is used to generate the mesh of the structure and the nodes of the mesh are set as corresponding coordinate samples
Figure PCTCN2022089786-appb-000049
Compared to the limitations of existing methods that are of high computational cost and cannot generalize to PDEs with various boundary shapes, the NBO can generalize to various boundary shapes and thus can estimate the solutions of the PDEs with a forward pass in each iteration of structural optimization, avoiding the expensive solving process of PDEs. As detailed above, the overall approach contains two stages. The first stage is collecting the dataset and training NBO. The second stage is to employ NBO to estimate the solutions of the PDEs in structural optimization. In the second stage, note that it may require NBO, which is an NN model, to make predictions on multiple points to evaluate the objective function J, especially when it has an integral term as shown in equation (3) for example, this provides a chance for GPU parallel acceleration.
Fig. 3 is a schematic diagram illustrating the structural optimization of Flow Baffles according to aspects of the disclosure.
As shown in Fig. 3, γ 2 to γ 5 located in corresponding grids are the flow baffles to be optimized. The goal of the structural optimization is to optimize the shape and position of the baffles γ 2 to γ 5 so as to obtain an even distribution of fluid flow at the outlet γ 1,  right with the little energy dissipated by the fluid.
The objective function of the structural optimization may be formulated based on fluid mechanics as shown in the following equation (10) :
Figure PCTCN2022089786-appb-000050
where β is a balance factor, for example, β = 0.01, u= (u 1, u 2) is the velocity, v is the viscosity, for example v = 1.
The governing PDEs describing the physical system related to the flow baffles may be formulated according to physical laws, for example, the PDEs may be NS equations as shown in the following equation (11) :
Figure PCTCN2022089786-appb-000051
Where x= (x 1, x 2) is the spatial coordinate, p is the pressure, u= (u 1, u 2) is the velocity, v is the viscosity, for example v = 1, γ 1, left is the left part of γ 1, γ 1, left, up is the upper half of γ 1, left , γ 1, left, down is the lower half of γ 1, left , γ wall =γ 1, up ∪γ 1, down ∪γ 2∪γ 3∪γ 4∪γ 5∪γ 1, left, down, and u 1 (x) is
Figure PCTCN2022089786-appb-000052
The structural parameters include the center and the radius of circular  baffles γ 2 to γ 5, that is, θ= (x 0, r 0, …, x 3, r 3) . The constraints W (θ) can be defined to confine each of γ 2 to γ 5 within its grid as shown in Fig. 3. In an embodiment, in order to make the sampling process efficient, a mapping of the structural parameter can be made: 
Figure PCTCN2022089786-appb-000053
where
Figure PCTCN2022089786-appb-000054
and minDist is the shortest distance from ith circle to the edge of the corresponding grid as shown in Fig. 3. Hence, the allowable values of each dimension of θ′ are in a closed interval and the allowable parameters can be normalized to [-3, 3]  12, where the superscript means 12 dimensions of the structural parameters. Let the final parameters as θ″, W (θ) is defined as:
Figure PCTCN2022089786-appb-000055
The training of the NBO model is then performed on this mapped space, which is a normalized structural space of the original structural space.
In an embodiment, the Adam algorithm may be utilized to optimize the structure of the baffles with NBO providing forward predictions of the PDEs as well as backward calculations of derivatives. In an example, the number of iterations of optimizing the structure θ is 200, the learning rate is 0.1. The loss function is defined as
Figure PCTCN2022089786-appb-000056
where λ is a predefined coefficient such as λ=100, ∥·∥ absSum stands for the sum of absolute values of all elements of a vector.
In an embodiment, a training data set for training the NBO model is generated. The NBO may have the structure as shown in Fig. 2A or 2B. It is appreciated that the NBO may also have other structure.
Assuming the data size of the data set is N, for example, N = 5000, which means 5000 structure instances
Figure PCTCN2022089786-appb-000057
are included in the data set. Firstly, a small subset of structural instances
Figure PCTCN2022089786-appb-000058
may be sampled according to uniform distribution, where N 1<<N, for example, N 1 = 100. The well-known FEM solver is used to generate the corresponding meshes for the structural instances as well as the values of the state variables {G (θ i) (x ij) ∣1≤i≤N 1, 1≤j≤M} according to the PDEs (11) , where the coordinate x ij corresponds to the node of the mesh, M is the number of nodes of the mesh, M may be a variable value related to the specific structure θ i. And the values of objective function
Figure PCTCN2022089786-appb-000059
are obtained according to the equation (10) . The estimator 
Figure PCTCN2022089786-appb-000060
of the objective function (10) may be trained based on
Figure PCTCN2022089786-appb-000061
The rest structural instances
Figure PCTCN2022089786-appb-000062
may be sampled according to the distribution defined in equation (7) with J replaced by
Figure PCTCN2022089786-appb-000063
For example, Markov Chain Monte Carlo (MCMC) method may be used to sample the rest 4900 structural instances according to the distribution defined in equation (7) . Then, the FEM solver is used to generate the corresponding meshes for the structural instances as well as the values of the state variables {G (θ i) (x ij) ∣N 1+1≤i≤N, 1≤j≤M} . And the training data set for  training the NBO is obtained, which is { (θ i, x ij, G (θ i) (x ij) ) ∣1≤i≤N, 1≤j≤M} . In an embodiment, the NBO may be trained based on the training objective function (5) .
In each iteration of the structural optimization, the trained NBO is used to estimate the state variables u and optional p, from which the objective J (θ) is obtained according to equation (10) . Then the loss 
Figure PCTCN2022089786-appb-000064
as shown in equation (13) is obtained, and the derivates of the loss 
Figure PCTCN2022089786-appb-000065
with respect to θ can be obtained accordingly. Finally the structural parameter θ is updated based on the loss 
Figure PCTCN2022089786-appb-000066
or its derivates in this structural optimization iteration. In an embodiment, the Adam algorithm may be utilized to update the structure θ with the aim of minimizing J shown in equation (10) .
Fig. 4 is a schematic diagram illustrating the structural optimization of conductive-media interfaces according to aspects of the disclosure.
The conductive-media interface shown in Fig. 4 may be an infinite-length conductive-media interface with thickness H = 8 and period L = 8. Ω 1 and Ω 2 are two conductive mediums with different thermal conductivity, governed by the PDEs as shown in the following equation (14) :
Figure PCTCN2022089786-appb-000067
Where x= (x 1, x 2) is the spatial coordinate, k 1 and k 2 are the thermal conductivity of Ω 1 and Ω 2 respectively, for example, k 1= 1 and k 2 = 2, y i is the temperature distribution of Ω i, i = 1, 2, and
Figure PCTCN2022089786-appb-000068
and
Figure PCTCN2022089786-appb-000069
are the unit normal for the Neumann boundary condition. The structure to be optimized is the conductive-media interface γ S represented by splines. The leftmost and rightmost anchor points of the splines are fixed (marked as circular dots in Fig. 4) , while the four middle anchor points are variable (marked as squared dots in Fig. 4) but within corresponding rectangular grids (marked as dotted lines in Fig. 4) . Given the positions of the four anchor points, the splines can be obtained by interpolation. Hence, the four anchor points are set as the structural parameters, i.e., θ= (x 0, x 1, x 2, x 3) .
The goal of the structural optimization is to maximize the heat transfer through the interface γ S by changing the structural parameters θ. The goal of the structural optimization may be described as shown in the following equation (15) :
Figure PCTCN2022089786-appb-000070
Then the goal may be converted to a minimization problem by taking the objective function J as 1/h T (y) , as shown in the following equation (16) :
J (θ) = 1/h T (y)                                                               (16)
The constraints W (θ) can be defined to confine each of anchor points within its grid as shown in Fig. 4. In an embodiment, the allowable parameters can be normalized to [-3, 3]  8, where the superscript means 8 dimensions of the structural parameters. Let the final parameters as θ″, W (θ) is defined as:
Figure PCTCN2022089786-appb-000071
The training of the NBO model is then performed on this mapped space, which is a normalized structural space of the original structural space.
In an embodiment, the Adam algorithm may be utilized to optimize the structure of the interface with NBO providing forward predictions of the PDEs as well as backward calculations of derivatives. In an example, the number of iterations of optimizing the structure θ is 200, the learning rate is 0.1. The loss function is defined as
Figure PCTCN2022089786-appb-000072
where λ is a predefined coefficient such as λ=100, ∥·∥ absSum stands for the sum of absolute values of all elements of a vector.
In an embodiment, a training data set for training the NBO model is generated. The NBO may have the structure as shown in Fig. 2A or 2B. It is appreciated that the NBO may also have other structure.
Assuming the data size of the data set is N, for example, N = 2000, which means 2000 structure instances
Figure PCTCN2022089786-appb-000073
are included in the data set. Firstly, a small subset of structural instances
Figure PCTCN2022089786-appb-000074
may be sampled according to uniform distribution, where N 1<<N, for example, N 1 = 100. The well-known FEM solver with AMR function is used to generate the corresponding meshes for the structural instances as well as the values of the state variables {G (θ i) (x ij) ∣1≤i≤N 1, 1≤j≤M} according to the PDEs (14) , where the coordinate x ij corresponds to the node of the mesh, M is the number of nodes of the mesh, M may be a variable value related to the specific structure θ i. And the values of objective function
Figure PCTCN2022089786-appb-000075
are obtained according to the equation (16) . The estimator
Figure PCTCN2022089786-appb-000076
of the objective function (16) may be trained based on
Figure PCTCN2022089786-appb-000077
The rest structural instances
Figure PCTCN2022089786-appb-000078
may be sampled according to the distribution defined in equation (7) with J replaced by
Figure PCTCN2022089786-appb-000079
For example, Markov Chain Monte Carlo (MCMC) method may be used to sample the rest 1900 structural instances according to the distribution defined in equation (7) . Then, the FEM solver is used to generate the corresponding meshes for the structural instances as well as the values of the state variables {G (θ i) (x ij) ∣N 1+1≤i≤N, 1≤j≤M} . And the training data set for training the NBO is obtained, which is { (θ i, x ij, G (θ i) (x ij) ) ∣1≤i≤N, 1≤j≤M} . In an embodiment, the NBO may be trained based on the training objective function (5) .
In each iteration of the structural optimization, the trained NBO is used to estimate the state variables y i, from which the objective J (θ) is obtained according to  equation (16) . Then the loss 
Figure PCTCN2022089786-appb-000080
as shown in equation (18) is obtained, and the derivates of the loss 
Figure PCTCN2022089786-appb-000081
with respect to θ can be obtained accordingly. The structural parameter θ is updated based on the loss 
Figure PCTCN2022089786-appb-000082
or its derivates in this structural optimization iteration. In an embodiment, the Adam algorithm may be utilized to update the structure θ with the aim of minimizing J shown in equation (16) .
It is appreciated that the structural optimization framework proposed in the disclosure is applicable to optimize the structure of any suitable object in addition to the specific objects exampled in Figs. 3 and 4. For example, the object to be structural optimized may be a part of a vehicle such as the car hood, a part of a plane such as the wine of the plane, a part of a rocket such as the rocket shall, fuel cell bipolar plate, pines of a reactor, or any suitable part of any suitable device.
In an embodiment, the process of the structural optimization is shown in the following table 1.
table 1
Figure PCTCN2022089786-appb-000083
Fig. 5 illustrates an exemplary process for optimizing structure of an object according to aspects of the disclosure. It is appreciated that the process may be implemented with computers or processors.
At block 510, structural parameters are received by a neural boundary operator (NBO) , wherein the structural parameters are used to describe boundary shape of the object, and the NBO is trained to map structural parameters of various boundary shapes of the object to approximations of solutions of partial differential  equations (PDEs) formulated to characterize a physical system related to the object. It is appreciated that the structural parameters may also include other structural related parameters such as information related to materials or the like, in addition to those describing the boundary shape.
At block 520, state variables are generated by the NBO from the structural parameters with a forward pass, wherein the state variables correspond to the solutions of the PDEs and are used to describe physical states of the physical system related to the object.
At block 530, an optimization objective value is calculated based on the state variables. It is appreciated that the optimization objective value may be calculated based on the state variables and the structural parameters.
At block 540, the structural parameters of the object are updated based on the optimization objective value.
In an embodiment, the processes at blocks 510 to 540 are repeated by taking the updated structural parameters obtained in last loop at block 540 as the structural parameters in current loop at block 510.
In an embodiment, the NBO comprises a branch network and a trunk network, the branch network takes the structural parameters as its input and outputs a first set of vectors, the trunk network takes coordinates of the object as its input and outputs a second set of vectors, wherein respective dot products between the first set of vectors and the second set of vectors are taken as the state variables. In an embodiment, the branch network and the trunk network are full connection networks.
In an embodiment, the NBO comprises a branch network, a trunk network and a port network, the branch network takes the structural parameters as its input and outputs a first set of vectors, the trunk network takes coordinates of the object as its input and outputs a second set of vectors, and the port network takes the first set of vectors and the second set of vectors as input and outputs the state variables. In an embodiment, the branch network, the trunk network and the port network are full connection networks.
In an embodiment, the process 500 further comprises collecting a training data set for training the NBO, wherein the training data set comprises a first number of sets of structural parameters corresponding to a first number of boundary shapes of the object and a first number of sets of state variables corresponding to the first number of sets of structural parameters, wherein the first number is the size of the training data set. The NBO is trained based on the training data set. It is appreciated that the first number of sets of structural parameters correspond to the structural instances
Figure PCTCN2022089786-appb-000084
as detailed above, where one set of structural parameters correspond to one structural instance θ i. Accordingly, the first number of sets of state variables correspond to the state variables {G (θ i) (x ij) ∣1≤i≤N, 1≤j≤M} of the structural instances
Figure PCTCN2022089786-appb-000085
as detailed above, where one set of state variables  correspond to the state variables {G (θ i) (x ij) ∣1≤j≤M} of one structural instance θ i.
In an embodiment, the collecting the training data set further comprises: initially sampling a second number of sets of structural parameters corresponding to a second number of boundary shapes of the object according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution; generating a second number of sets of state variables by using a numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters; sampling a third number of sets of structural parameters corresponding to a third number of boundary shapes of the object according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the second number of sets of structural parameters; and generating a third number of sets of state variables by using the numerical solver to solve the PDEs of the object based on the third number of sets of structural parameters, wherein the first number of sets of structural parameters consist of the second number of sets of structural parameters and the third number of sets of structural parameters, the first number of sets of state variables consist of the second number of sets of state variables and the third number of sets of state variables. In an embodiment, the numerical solver is a finite element methods (FEM) solver.
In an embodiment, the second distribution is determined based further on the optimization objective value of unsampled structural parameters of the object. In an embodiment, the optimization objective value of the unsampled structural parameters of the object is estimated by an estimator, wherein the estimator is trained based on the second number of sets of structural parameters and a second number of corresponding optimization objective values, wherein the second number of corresponding optimization objective values are obtained based on the second number of sets of state variables.
In an embodiment, the second distribution p (θ) is determined by means of the following equation: 
Figure PCTCN2022089786-appb-000086
wherein J (θ) denotes the optimization objective function of the unsampled structural parameters θ, 
Figure PCTCN2022089786-appb-000087
denotes a balance factor, S t denotes a set of θ i sampled so far, ∥θ i-θ∥ 2 denotes l 2 norm.
In an embodiment, the object is one of a fuel cell bipolar plate, a part of a car, a part of a plane, a part of a building, pipes of a reactor, flow baffles. In an embodiment, the structural parameters comprise at least one of position, radius, width, height, length, anchor points. In an embodiment, the state variables comprise at least one of velocity, pressure, temperature.
Fig. 6 illustrates an exemplary process for collecting a training data set for training a neural boundary operator (NBO) . The NBO is trained to map structural parameters of boundary shapes of an object to approximations of solutions of partial  differential equations (PDEs) formulated to characterize a physical system related to the object, wherein the solutions of PDEs correspond to state variables used to describe physical states of the physical system related to the object.
At block 610, a first number of sets of structural parameters corresponding to a first number of boundary shapes of the object are initially sampled according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution.
At block 620, a first number of sets of state variables are generated by using a numerical solver to solve the PDEs of the object based on the first number of sets of structural parameters.
At block 630, a second number of sets of structural parameters corresponding to a second number of boundary shapes of the object are sampled according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the first number of sets of structural parameters.
At block 640, a second number of sets of state variables are generated by using the numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters. The first number of sets of structural parameters, the corresponding first number of sets of state variables, the second number of sets of structural parameters, and the corresponding second number of sets of state variables are included in the training data set.
In an embodiment, the second distribution is determined based further on the optimization objective value of unsampled structural parameters of the object. In an embodiment, the optimization objective value of the unsampled structural parameters of the object is estimated by an estimator, wherein the estimator is trained based on the first number of sets of structural parameters and a first number of corresponding optimization objective values, wherein the first number of corresponding optimization objective values are obtained based on the first number of sets of state variables.
In an embodiment, the second distribution p (θ) is determined by means of the following equation: 
Figure PCTCN2022089786-appb-000088
wherein J (θ) denotes the optimization objective function of the unsampled structural parameters θ, 
Figure PCTCN2022089786-appb-000089
denotes a balance factor, S t denotes a set of θ i sampled so far, ∥θ i-θ∥ 2 denotes l 2 norm.
Fig. 7 illustrates an exemplary computing system according to aspects of the disclosure. The computing system 700 may comprise at least one processor 710. The computing system 700 may further comprise at least one storage device 720. The storage device 720 may store computer-executable instructions that, when executed, cause the processor 710 to perform any operations according to the embodiments of the present disclosure as described in connection with Figs. 1-6.
The embodiments of the present disclosure may be embodied in a computer-readable medium such as non-transitory computer-readable medium. The non-transitory computer-readable medium may comprise instructions that, when executed, cause one or more processors to perform any operations according to the embodiments of the present disclosure as described in connection with Figs. 1-6.
The embodiments of the present disclosure may be embodied in a computer program product comprising computer-executable instructions that, when executed, cause one or more processors to perform any operations according to the embodiments of the present disclosure as described in connection with Figs. 1-6.
It should be appreciated that all the operations in the methods described above are merely exemplary, and the present disclosure is not limited to any operations in the methods or sequence orders of these operations, and should cover all other equivalents under the same or similar concepts.
It should also be appreciated that all the modules in the apparatuses described above may be implemented in various approaches. These modules may be implemented as hardware, software, or a combination thereof. Moreover, any of these modules may be further functionally divided into sub-modules or combined together.
The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects. Thus, the claims are not intended to be limited to the aspects shown herein. All structural and functional equivalents to the elements of the various aspects described throughout the present disclosure that are known or later come to be known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the claims.

Claims (20)

  1. A computer implemented method for optimizing structure of an object, comprising:
    receiving structural parameters by a neural boundary operator (NBO) , wherein the structural parameters are used to describe boundary shape of the object, and the NBO is trained to map structural parameters of boundary shapes of the object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object;
    generating state variables by the NBO from the structural parameters with a forward pass, wherein the state variables correspond to the solutions of the PDEs and are used to describe physical states of the physical system related to the object;
    calculating an optimization objective value based on the state variables; and
    updating the structural parameters of the object based on the optimization objective value.
  2. The method of claim 1, further comprising:
    repeating the receiving step, the generating step, the calculating step and the updating step by taking the updated structural parameters in the updating step as the structural parameters in the receiving step.
  3. The method of claim 1, wherein the NBO comprises a branch network and a trunk network, the branch network takes the structural parameters as its input and outputs a first set of vectors, the trunk network takes coordinates of the object as its input and outputs a second set of vectors, wherein respective dot products between the first set of vectors and the second set of vectors are taken as the state variables.
  4. The method of claim 1, wherein the NBO comprises a branch network, a trunk network and a port network, the branch network takes the structural parameters as its input and outputs a first set of vectors, the trunk network takes coordinates of the object as its input and outputs a second set of vectors, and the port network takes the first set of vectors and the second set of vectors as input and outputs the state variables.
  5. The method of claim 4, wherein the branch network, the trunk network and the port network are full connection networks.
  6. The method of claim 1, further comprising:
    collecting a training data set for training the NBO, wherein the training data set comprises a first number of sets of structural parameters corresponding to a first  number of boundary shapes of the object and a first number of sets of state variables corresponding to the first number of sets of structural parameters; and
    training the NBO based on the training data set.
  7. The method of claim 6, wherein the collecting the training data set further comprising:
    sampling a second number of sets of structural parameters corresponding to a second number of boundary shapes of the object according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution;
    generating a second number of sets of state variables by using a numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters;
    sampling a third number of sets of structural parameters corresponding to a third number of boundary shapes of the object according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the second number of sets of structural parameters; and
    generating a third number of sets of state variables by using the numerical solver to solve the PDEs of the object based on the third number of sets of structural parameters,
    wherein the first number of sets of structural parameters consist of the second number of sets of structural parameters and the third number of sets of structural parameters, the first number of sets of state variables consist of the second number of sets of state variables and the third number of sets of state variables.
  8. The method of claim 7, wherein the numerical solver is a finite element methods (FEM) solver.
  9. The method of claim 7, wherein the second distribution is determined based further on the optimization objective value of unsampled structural parameters of the object.
  10. The method of claim 9, wherein the optimization objective value of the unsampled structural parameters of the object is estimated by an estimator, wherein the estimator is trained based on the second number of sets of structural parameters and a second number of corresponding optimization objective values, wherein the second number of corresponding optimization objective values are obtained based on the second number of sets of state variables.
  11. The method of claim 9, wherein the second distribution p (θ) is determined by means of the following equation: 
    Figure PCTCN2022089786-appb-100001
    Figure PCTCN2022089786-appb-100002
    wherein J (θ) denotes the optimization objective function of the unsampled structural parameters θ, 
    Figure PCTCN2022089786-appb-100003
    denotes a balance factor, S t denotes a set of θ i sampled so far, ||·|| 2 denotes l 2 norm.
  12. The method of claim 1, wherein the object is one of a fuel cell bipolar plate, a part of a car, a part of a plane, a part of a building, pipes of a reactor, flow baffles.
  13. The method of claim 1, wherein the structural parameters comprise at least one of position, radius, width, height, length, anchor points, and the state variables comprise at least one of velocity, pressure, temperature.
  14. A method for collecting a training data set for training a neural boundary operator (NBO) , wherein the NBO is trained to map structural parameters of boundary shapes of an object to approximations of solutions of partial differential equations (PDEs) formulated to characterize a physical system related to the object, wherein the solutions of PDEs correspond to state variables used to describe physical states of the physical system related to the object, the method comprising:
    sampling a first number of sets of structural parameters corresponding to a first number of boundary shapes of the object according to a first distribution of the structural parameters of the object, wherein the first distribution is uniform distribution;
    generating a first number of sets of state variables by using a numerical solver to solve the PDEs of the object based on the first number of sets of structural parameters;
    sampling a second number of sets of structural parameters corresponding to a second number of boundary shapes of the object according to a second distribution of the structural parameters of the object, wherein the second distribution is determined based on the first number of sets of structural parameters; and
    generating a second number of sets of state variables by using the numerical solver to solve the PDEs of the object based on the second number of sets of structural parameters,
    wherein the first number of sets of structural parameters, the corresponding first number of sets of state variables, the second number of sets of structural parameters, and the corresponding second number of sets of state variables are included in the training data set.
  15. The method of claim 14, wherein the second distribution is determined based further on the optimization objective value of unsampled structural parameters of the object.
  16. The method of claim 15, wherein the optimization objective value of the unsampled structural parameters of the object is estimated by an estimator, wherein the estimator is trained based on the first number of sets of structural parameters and a first number of corresponding optimization objective values, wherein the first number of corresponding optimization objective values are obtained based on the first number of sets of state variables.
  17. The method of claim 15, wherein the second distribution p (θ) is determined by means of the following equation: 
    Figure PCTCN2022089786-appb-100004
    Figure PCTCN2022089786-appb-100005
    wherein J (θ) denotes the optimization objective function of the unsampled structural parameters θ, 
    Figure PCTCN2022089786-appb-100006
    denotes a balance factor, S t denotes a set of θ i sampled so far, ||·|| 2 denotes l 2 norm.
  18. A computer system, comprising:
    one or more processors; and
    one or more storage devices storing computer-executable instructions that, when executed, cause the one or more processors to perform the operations of the method of one of claims 1-17.
  19. One or more computer readable storage media storing computer-executable instructions that, when executed, cause one or more processors to perform the operations of the method of one of claims 1-17.
  20. A computer program product comprising computer-executable instructions that, when executed, cause one or more processors to perform the operations of the method of one of claims 1-17.
PCT/CN2022/089786 2022-04-28 2022-04-28 Method and apparatus for structure optimizition WO2023206204A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/089786 WO2023206204A1 (en) 2022-04-28 2022-04-28 Method and apparatus for structure optimizition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/089786 WO2023206204A1 (en) 2022-04-28 2022-04-28 Method and apparatus for structure optimizition

Publications (1)

Publication Number Publication Date
WO2023206204A1 true WO2023206204A1 (en) 2023-11-02

Family

ID=88516710

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/089786 WO2023206204A1 (en) 2022-04-28 2022-04-28 Method and apparatus for structure optimizition

Country Status (1)

Country Link
WO (1) WO2023206204A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117521452A (en) * 2023-11-07 2024-02-06 之江实验室 Robot structural member optimization method and device based on space-time finite element model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104778327A (en) * 2015-04-23 2015-07-15 复旦大学 Airplane airfoil design optimization method based on artificial neural network
US20210295167A1 (en) * 2020-03-23 2021-09-23 Ansys, Inc. Generative networks for physics based simulations
US20220076130A1 (en) * 2020-08-31 2022-03-10 International Business Machines Corporation Deep surrogate langevin sampling for multi-objective constraint black box optimization with applications to optimal inverse design problems
US20220091580A1 (en) * 2020-06-26 2022-03-24 Autodesk, Inc. Generative design shape optimization with singularities and disconnection prevention for computer aided design and manufacturing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104778327A (en) * 2015-04-23 2015-07-15 复旦大学 Airplane airfoil design optimization method based on artificial neural network
US20210295167A1 (en) * 2020-03-23 2021-09-23 Ansys, Inc. Generative networks for physics based simulations
US20220091580A1 (en) * 2020-06-26 2022-03-24 Autodesk, Inc. Generative design shape optimization with singularities and disconnection prevention for computer aided design and manufacturing
US20220076130A1 (en) * 2020-08-31 2022-03-10 International Business Machines Corporation Deep surrogate langevin sampling for multi-objective constraint black box optimization with applications to optimal inverse design problems

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117521452A (en) * 2023-11-07 2024-02-06 之江实验室 Robot structural member optimization method and device based on space-time finite element model
CN117521452B (en) * 2023-11-07 2024-05-07 之江实验室 Robot structural member optimization method and device based on space-time finite element model

Similar Documents

Publication Publication Date Title
Colbrook The mpEDMD algorithm for data-driven computations of measure-preserving dynamical systems
Praveen et al. Low cost PSO using metamodels and inexact pre-evaluation: Application to aerodynamic shape design
Serani et al. Hull-form stochastic optimization via computational-cost reduction methods
Koziel et al. Knowledge-based airfoil shape optimization using space mapping
Pehlivanoglu et al. Aerodynamic design prediction using surrogate-based modeling in genetic algorithm architecture
Amsallem et al. Real-time solution of linear computational problems using databases of parametric reduced-order models with arbitrary underlying meshes
Duvigneau et al. Kriging‐based optimization applied to flow control
Katz Meshless methods for computational fluid dynamics
Lee et al. Development of an optimized trend kriging model using regression analysis and selection process for optimal subset of basis functions
CN113283186A (en) Universal grid self-adaption method for CFD
Mojgani et al. Lagrangian pinns: A causality-conforming solution to failure modes of physics-informed neural networks
Peng et al. Linear attention coupled Fourier neural operator for simulation of three-dimensional turbulence
WO2023206204A1 (en) Method and apparatus for structure optimizition
White et al. Fast neural network predictions from constrained aerodynamics datasets
Renganathan Koopman-based approach to nonintrusive reduced order modeling: Application to aerodynamic shape optimization and uncertainty propagation
Essadki et al. Adaptive mesh refinement and high order geometrical moment method for the simulation of polydisperse evaporating sprays
Fischer et al. Bayesian-enhanced low-fidelity correction approach to multifidelity aerospace design
US20180260499A1 (en) Performing lagrangian particle tracking with adaptive sampling to provide a user-defined level of performance
Danvin et al. Laminar to turbulent transition prediction in hypersonic flows with metamodels.
Zhu et al. Design of an RBF surrogate model for low Reynolds number airfoil based on transfer learning
Zheng et al. Nonlinear manifold learning and model reduction for transonic flows
Amsallem et al. Real-time solution of computational problems using databases of parametric linear reduced-order models with arbitrary underlying meshes
Chandramoorthy et al. Sensitivity computation of statistically stationary quantities in turbulent flows
Benz An introduction to computational methods in hydrodynamics
Yang et al. Non-matching meshes data transfer using Kriging model and greedy algorithm

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22939056

Country of ref document: EP

Kind code of ref document: A1