Figure 3: Example of surrogate modelling
Figure 3 shows how simple design variables such as material thickness and width can result in demand for a high number of FEA simulations to determine the geometry that is able to withstand the highest load due to the vast design space. Within a simple scenario such as Figure 3, experienced engineers can apply intuition to their designs but multi objective optimisation is still a challenge within complex devices.
1. Polynomial Response Surfaces
Polynomial Response Surfaces approximate a system’s behaviour using polynomial equations. Typically, these models are used for problems with relatively smooth responses, where relationships between input variables (like design parameters) and outputs (like performance measures) can be expressed as low-order polynomials.
Applications of PRS models include:
- Predicting stress-strain relationships in materials
- Approximation of system dynamics in a mechanical design.
Polynomial Response Surface models are popular due to their simplicity, interpretability and low computational cost. They are well-suited for problems with low to moderate nonlinearity, small design spaces and where insight into variable relationships is valuable. PRS models are easy to implement using standard regression techniques and provide smooth, differentiable approximations, making them ideal for optimisation tasks.
However, PRS models have limitations as they struggle with highly nonlinear or complex problems, are prone to overfitting with high-order polynomials and become impractical for high-dimensional input spaces due to the curse of dimensionality. PRS models also assume smoothness in the response surface (visual representation of the system response to a change in one or more input), making them unsuitable for problems with abrupt changes or discontinuities. Additionally, they struggle to accurately extrapolate outside of the data range they were trained on and are sensitive to input scaling.
2. Kriging Models
Kriging, also known as Gaussian Process Regression (GPR), creates a probabilistic model that predicts system behaviour and provides uncertainty estimates. It is particularly effective for systems with limited data and nonlinearity.
Applications of Kriging Models include:
- Optimising stent geometry
- Sensitivity analysis in structural mechanics.
Kriging excels in capturing complex, nonlinear relationships in design problems as it can efficiently model underlying function with minimal assumptions. One of its key strengths is its ability to provide not only predictions but also a measure of uncertainty for each output, making it ideal for tasks that require confidence in the model’s reliability, such as optimising geometry for patient-specific solutions. Kriging models are highly flexible, capable of handling small to medium-sized datasets with varying degrees of smoothness and noise.
With stronger ability to handle complex design problems, Kriging brings an increased computational burden. The computational cost rises with the number of input dimensions or data points, making it less suitable for large-scale problems. Kriging requires careful selection of kernel functions (functions that quantify similarity between a pair of data points) and hyperparameters (parameters that control how a model learns) to ensure accurate modelling. It can struggle with very high-dimensional spaces due to the resulting computational burden.