Abstract

The assessment of system performance and identification of failure mechanisms in complex engineering systems often requires the use of computation-intensive finite element software or physical experiments, which are both costly and time-consuming. Moreover, when accounting for uncertainties in the manufacturing process, material properties, and loading conditions, the process of reliability-based design optimization (RBDO) for complex engineering systems necessitates the repeated execution of expensive tasks throughout the optimization process. To address this problem, this paper proposes a novel methodology for RBDO. First, a multi-fidelity surrogate modeling strategy is presented, leveraging partially observed information (POI) from diverse sources with varying fidelity and dimensionality to reduce computational cost associated with evaluating expensive high-dimensional complex systems. Second, a multi-task surrogate modeling framework is proposed to address the concurrent evaluation of multiple constraints for each design point. The multi-task framework aids in the development of surrogate models and enhances the effectiveness of reliability analysis and design optimization. The proposed multi-fidelity multi-task machine learning model utilizes a Bayesian framework, which significantly improves the performance of the predictive model and provides uncertainty quantification of the prediction. Additionally, the model provides a highly accurate and efficient framework for reliability-based design optimization through knowledge sharing. The proposed method was applied to two design case studies. By incorporating POI from various sources, the proposed approach improves the accuracy and efficiency of system performance prediction, while simultaneously addressing the cost and complexity associated with the design of complex systems.

Graphical Abstract Figure
Graphical Abstract Figure
Close modal

References

1.
Kohtz
,
S.
,
Xu
,
Y.
,
Zheng
,
Z.
, and
Wang
,
P.
,
2022
, “
Physics-Informed Machine Learning Model for Battery State of Health Prognostics Using Partial Charging Segments
,”
Mech. Syst. Signal Process.
,
172
(
6
), p.
109002
.
2.
Bansal
,
P.
,
Zheng
,
Z.
,
Shao
,
C.
,
Li
,
J.
,
Banu
,
M.
,
Carlson
,
B. E.
, and
Li
,
Y.
,
2022
, “
Physics-Informed Machine Learning Assisted Uncertainty Quantification for the Corrosion of Dissimilar Material Joints
,”
Reliab. Eng. Syst. Saf.
,
227
(
11
), p.
108711
.
3.
Chen
,
X.
,
Zhou
,
H.
, and
Li
,
Y.
,
2019
, “
Effective Design Space Exploration of Gradient Nanostructured Materials Using Active Learning Based Surrogate Models
,”
Mater. Des.
,
183
(
12
), p.
108085
.
4.
Li
,
Y.
,
Xiao
,
W.
, and
Wang
,
P.
,
2018
,
Uncertainty Quantification of Artificial Neural Network Based Machine Learning Potentials
(
ASME International Mechanical Engineering Congress and Exposition
, Vol.
52170
,
American Society of Mechanical Engineers
, p.
V012T11A030
.
5.
Liu
,
D.
, and
Wang
,
Y.
,
2019
, “
Multi-fidelity Physics-Constrained Neural Network and Its Application in Materials Modeling
,”
ASME J. Mech. Des.
,
141
(
12
), p.
121403
.
6.
Zheng
,
Z.
,
Chen
,
B.
,
Xu
,
Y.
,
Fritz
,
N.
,
Gurumukhi
,
Y.
,
Cook
,
J.
,
Ates
,
M. N.
,
Miljkovic
,
N.
,
Braun
,
P. V.
, and
Wang
,
P.
,
2021
, “
A Gaussian Process-Based Crack Pattern Modeling Approach for Battery Anode Materials Design
,”
ASME J. Electrochem. Energy Convers. Storage
,
18
(
1
), p.
011011
.
7.
Xu
,
Y.
,
Lalwani
,
A. V.
,
Arora
,
K.
,
Zheng
,
Z.
,
Renteria
,
A.
,
Senesky
,
D. G.
, and
Wang
,
P.
,
2022
, “
Hall-Effect Sensor Design With Physics-Informed Gaussian Process Modeling
,”
IEEE Sens. J.
,
22
(
23
), pp.
22519
22528
.
8.
Zheng
,
Z.
,
Xu
,
Y.
, and
Wang
,
P.
,
2021
, “
Uncertainty Quantification Analysis on Mechanical Properties of the Structured Silicon Anode Via Surrogate Models
,”
J. Electrochem. Soc.
,
168
(
4
), p.
040508
.
9.
Xu
,
Y.
, and
Wang
,
P.
,
2019
, “
A Comparison of Numerical Optimizers in Developing High Dimensional Surrogate Models
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
59193
,
American Society of Mechanical Engineers
, p.
V02BT03A037
.
10.
Xu
,
Y.
, and
Wang
,
P.
,
2020
, “
Rare Event Estimation of High Dimensional Problems With Confidence Intervals
,”
IIE Annual Conference Proceedings
,
Virtual, Online
,
Nov 1–3
,
Institute of Industrial and Systems Engineers (IISE)
, pp.
31A
36A
.
11.
Xu
,
Y.
, and
Wang
,
P.
,
2020
, “
Sequential Sampling Based Reliability Analysis for High Dimensional Rare Events With Confidence Intervals
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
84010
,
American Society of Mechanical Engineers
, p.
V11BT11A039
.
12.
Xu
,
Y.
, and
Wang
,
P.
,
2021
, “
An Enhanced Squared Exponential Kernel With Manhattan Similarity Measure for High Dimensional Gaussian Process Models
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
85390
,
American Society of Mechanical Engineers
, p.
V03BT03A025
.
13.
Xu
,
Y.
,
Kohtz
,
S.
,
Boakye
,
J.
,
Gardoni
,
P.
, and
Wang
,
P.
,
2022
, “
Physics-Informed Machine Learning for Reliability and Systems Safety Applications: State of the Art and Challenges
,”
Reliab. Eng. Syst. Saf.
,
230
, p.
108900
.
14.
Xu
,
Y.
, and
Wang
,
P.
,
2022
, “
Reliability Analysis With Partially Observed Information
,”
2022 Annual Reliability and Maintainability Symposium (RAMS)
,
Tucson, AZ
,
Jan. 24–27
,
IEEE
, pp.
1
6
.
15.
Wu
,
H.
,
Zhu
,
Z.
, and
Du
,
X.
,
2020
, “
System Reliability Analysis With Autocorrelated Kriging Predictions
,”
ASME J. Mech. Des.
,
142
(
10
), p.
101702
.
16.
Wu
,
H.
,
Hu
,
Z.
, and
Du
,
X.
,
2021
, “
Time-Dependent System Reliability Analysis With Second-Order Reliability Method
,”
ASME J. Mech. Des.
,
143
(
3
), p.
031101
.
17.
Xu
,
Y.
, and
Wang
,
P.
,
2023
, “
Physics-Constrained Machine Learning for Reliability-Based Design Optimization
,”
2023 Annual Reliability and Maintainability Symposium (RAMS)
,
Orlando, FL
,
Jan. 23–26
,
IEEE
, pp.
1
6
.
18.
Wu
,
H.
, and
Du
,
X.
,
2022
, “
Envelope Method for Time-and Space-Dependent Reliability Prediction
,”
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part B: Mech. Eng.
,
8
(
4
), p.
041201
.
19.
Caruana
,
R.
,
1998
,
Multitask Learning
,
Springer
,
Boston, MA
.
20.
Schwaighofer
,
A.
,
Tresp
,
V.
, and
Yu
,
K.
,
2004
, “
Learning Gaussian Process Kernels Via Hierarchical Bayes
,”
Adv. Neural Inform. Process. Syst.
,
17
, pp.
1209
1216
.
21.
Dempster
,
A. P.
,
Laird
,
N. M.
, and
Rubin
,
D. B.
,
1977
, “
Maximum Likelihood From Incomplete Data Via the EM Algorithm
,”
J. R. Statist. Soc.: Series B (Methodological)
,
39
(
1
), pp.
1
22
.
22.
Shi
,
J. Q.
,
Murray-Smith
,
R.
, and
Titterington
,
D. M.
,
2005
, “
Hierarchical Gaussian Process Mixtures for Regression
,”
Statist. Comput.
,
15
(
1
), pp.
31
41
.
23.
Yu
,
K.
,
Tresp
,
V.
, and
Schwaighofer
,
A.
,
2005
, “
Learning Gaussian Processes From Multiple Tasks
,”
Proceedings of the 22nd international Conference on Machine Learning
,
Bonn, Germany
,
August
, pp.
1012
1019
.
24.
Bonilla
,
E. V.
,
Chai
,
K.
, and
Williams
,
C.
,
2007
, “
Multi-task Gaussian Process Prediction
,”
Adv. Neural Inform. Process. Syst.
,
20
, pp.
153
160
.
25.
Hayashi
,
K.
,
Takenouchi
,
T.
,
Tomioka
,
R.
, and
Kashima
,
H.
,
2012
, “
Self-Measuring Similarity for Multi-task Gaussian Process
,”
Proceedings of ICML Workshop on Unsupervised and Transfer Learning
,
Bellevue, WA
,
July
,
JMLR Workshop and Conference Proceedings
, pp.
145
153
.
26.
Rakitsch
,
B.
,
Lippert
,
C.
,
Borgwardt
,
K.
, and
Stegle
,
O.
,
2013
, “
It Is All in the Noise: Efficient Multi-task Gaussian Process Inference With Structured Residuals
,”
Adv. Neural Inform. Process. Syst.
,
26
, pp.
1466
1474
.
27.
Zhu
,
J.
, and
Sun
,
S.
,
2014
, “
Multi-task Sparse Gaussian Processes With Improved Multi-task Sparsity Regularization
,” Pattern Recognition: 6th Chinese Conference, CCPR 2014, Changsha, China, Nov. 17–19, 2014. Proceedings, Part I 6,
Springer
, pp.
54
62
.
28.
Tan
,
Z.
,
De
,
G.
,
Li
,
M.
,
Lin
,
H.
,
Yang
,
S.
,
Huang
,
L.
, and
Tan
,
Q.
,
2020
, “
Combined Electricity-Heat-Cooling-Gas Load Forecasting Model for Integrated Energy System Based on Multi-task Learning and Least Square Support Vector Machine
,”
J. Clean. Prod.
,
248
(
3
), p.
119252
.
29.
Xu
,
Y.
,
Renteria
,
A.
, and
Wang
,
P.
,
2022
, “
Adaptive Surrogate Models With Partially Observed Information
,”
Reliab. Eng. Syst. Saf.
,
225
(
9
), p.
108566
.
30.
Xu
,
Y.
, and
Wang
,
P.
,
2022
,
Adaptive Surrogate Models for Uncertainty Quantification With Partially Observed Information
,
AIAA SCITECH 2022 Forum
, p.
1439
.
31.
Xu
,
Y.
, and
Wang
,
P.
,
2022
, “
Hierarchical Surrogate Modeling With Multiple Order Partially Observed Information
,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol.
86236
,
American Society of Mechanical Engineers
, p.
V03BT03A025
.
32.
Damianou
,
A. C.
,
Titsias
,
M. K.
, and
Lawrence
,
N.
,
2016
, Variational Inference for Latent Variables and Uncertain Inputs in Gaussian Processes.
33.
Titsias
,
M.
, and
Lawrence
,
N. D.
,
2010
, “
Bayesian Gaussian Process Latent Variable Model
,”
Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics
,
Sardinia, Italy
,
May 13–15
,
JMLR Workshop and Conference Proceedings
, pp.
844
851
.
34.
Williams
,
C. K.
, and
Rasmussen
,
C. E.
,
2006
,
Gaussian Processes for Machine Learning
, Vol.
2
,
MIT Press
,
Cambridge, MA
.
35.
Zhou
,
Y.
,
Liu
,
Y.
,
Wang
,
D.
,
De
,
G.
,
Li
,
Y.
,
Liu
,
X.
, and
Wang
,
Y.
,
2021
, “
A Novel Combined Multi-task Learning and Gaussian Process Regression Model for the Prediction of Multi-timescale and Multi-component of Solar Radiation
,”
J. Clean. Prod.
,
284
(
2
), p.
124710
.
36.
Zhang
,
Y.
, and
Yang
,
Q.
,
2021
, “
A Survey on Multi-task Learning
,”
IEEE Trans. Knowl. Data. Eng.
,
34
(
12
), pp.
5586
5609
.
37.
Standley
,
T.
,
Zamir
,
A.
,
Chen
,
D.
,
Guibas
,
L.
,
Malik
,
J.
, and
Savarese
,
S.
,
2020
, “
Which Tasks Should Be Learned Together in Multi-task Learning?
,”
International Conference on Machine Learning
,
Vienna, Austria
,
July 12–18
,
PMLR
, pp.
9120
9132
.
38.
Fifty
,
C.
,
Amid
,
E.
,
Zhao
,
Z.
,
Yu
,
T.
,
Anil
,
R.
, and
Finn
,
C.
,
2021
, “
Efficiently Identifying Task Groupings for Multi-task Learning
,”
Adv. Neural Inform. Process. Syst.
,
34
, pp.
27503
27516
. arXiv:2109.04617
39.
Sun
,
X.
,
Panda
,
R.
,
Feris
,
R.
, and
Saenko
,
K.
,
2020
, “
Adashare: Learning What to Share for Efficient Deep Multi-task Learning
,”
Adv. Neural Inform. Process. Syst.
,
33
, pp.
8728
8740
. arXiv:1911.12423
40.
Liu
,
H.
,
Ong
,
Y.-S.
,
Shen
,
X.
, and
Cai
,
J.
,
2020
, “
When Gaussian Process Meets Big Data: A Review of Scalable GPs
,”
IEEE Trans. Neural Netw. Learn. Syst.
,
31
(
11
), pp.
4405
4423
.
41.
Genton
,
M. G.
, and
Kleiber
,
W.
,
2015
, Cross-Covariance Functions for Multivariate Geostatistics.
42.
Alvarez
,
M. A.
,
Rosasco
,
L.
, and
Lawrence
,
N. D.
,
2012
, “
Kernels for Vector-Valued Functions: A Review
,”
Found. Trends Mach. Learn.
,
4
(
3
), pp.
195
266
.
43.
Xu
,
Y.
, and
Wang
,
P.
,
2021
, “
CVaR Formulation of Reliability-Based Design Problems Considering the Risk of Extreme Failure Events
,”
2021 Annual Reliability and Maintainability Symposium (RAMS)
,
Orlando, FL
,
Jan. 25–28
,
IEEE
, pp.
1
5
.
44.
Zhao
,
Z.
,
Xu
,
Y.
,
Lin
,
Y.-F.
,
Wang
,
X.
, and
Wang
,
P.
,
2021
, “
Probabilistic Modeling and Reliability-Based Design Optimization of a Ground Source Heat Pump System
,”
Appl. Therm. Eng.
,
197
(
10
), p.
117341
.
You do not currently have access to this content.