Application of Machine Learning in Structural Engineering: A Review of Predictive Models and Design Optimization
Article Sidebar
Main Article Content
Abstract
In the field of mechanical engineering served as a tool for addressing complex problems in the Structural Engineering due to enabling fact-pushed structural framework evaluation, prediction and optimisation. Different from different literature opinions in concentrating mainly around individual machine learning machine learning paradigm and individual structural application areas, right here we develop a unified and contrasting research for supervised, unsupervised and reinforcement learning methods in the context of structural engineering along with the current developments of physics-informed and hybrid learning frameworks for future Structural Engineering. In the present statistical era, and the advancements made in processing capacity, a mixed framework is examined with the less complex strategy to deal with established engineering solutions towards applying neighbourhood engineering for starting point and detailing the easy way of the examine gadget, and the supervised based totally on memorisation, unsupervised and the reinforcements for each one the paradigms within the Structural Engineering together with structural diagram automatic checks, optimisation, structural overall health tracking, and consequently on. Apart from the statistical efficiency of various gadgets concerning algorithmic intricacy, desirable characteristics, merits and demerits, comparison features related to style discovering of the multi machines also be examined; the content will straight handle with the main limitations of smart systems that prevent a widespread adoption in structural engineering research, the consequences of combination of physics based models with the artificial intelligence demonstrate a terrific prospect for enhancing performance in structural check, monitoring, style procedures, but, we highlight a need of hybrid approach in blending data driven methods along with customary engineering principles, with special reference to their relevance to use in the linear frameworks within the structure study.
Article Details
Section
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Licensed under a CC-BY license: https://creativecommons.org/licenses/by-nc-sa/4.0/
How to Cite
References
[1] L. Zhou, S. Pan, J. Wang, and V. Vasilakos, “Machine learning on big data: Opportunities and challenges,” Neurocomputing, vol. 237, pp. 350–361, 2017.
[2] K. Sui and W. Lee, “Image processing analysis and research based on game animation design,” Journal of Visual Communication and Image Representation, vol. 64, pp. 94–100, 2019.
[3] T. Yang, C. Cappelle, Y. Ruichek, and M. Bagdouri, “Multi-object tracking with discriminant correlation filter based deep learning tracker,” Integrated Computer-Aided Engineering, vol. 26, pp. 273–284, 2019.
[4] F. Syed, M. Tahir, M. Rafi, and M. Shahab, “Feature selection for semi-supervised multi-target regression using genetic algorithm,” Applied Intelligence, vol. 51, pp. 8961–8984, 2021.
[5] P. Wang and X. Bai, “Regional parallel structural based CNN for thermal infrared face identification,” Integrated Computer-Aided Engineering, vol. 25, pp. 247–260, 2018.
[6] S. Choppala, T. W. Kelmar, M. Chierichetti, F. Davoudi, and D. Huang, “Optimal sensor location and stress prediction on a plate using machine learning,” in Proc. AIAA SciTech Forum, Online, Jan. 23–27, 2023.
[7] S. Badillo et al., “An introduction to machine learning,” Clinical Pharmacology & Therapeutics, vol. 107, pp. 871–885, 2020.
[8] S. Karmaker, M. Hassan, M. Smith, L. Xu, and C. Zhai, “ACM computing surveys,” Knowledge and Information Systems, vol. 54, pp. 1–36, 2022.
[9] A. Laisisi and N. Attoh-Okine, “Principal components analysis and track quality index: A machine learning approach,” Transportation Research Part C: Emerging Technologies, vol. 91, pp. 230–248, 2018.
[10] Q. Le, “Building high-level features using large scale unsupervised learning,” in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, May 26–31, 2013, pp. 8595–8598.
[11] J. Zhang, X. Zhao, and X. Wei, “Reinforcement learning-based structural control of floating wind turbines,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 52, pp. 1603–1613, 2020.
[12] A. Jain, “Data clustering: 50 years beyond K-means,” Pattern Recognition Letters, vol. 31, pp. 651–666, 2010.
[13] J. Zhang, M. Xiao, M. Gao, and S. Chu, “Probability and interval hybrid reliability analysis based on adaptive local approximation of projection outlines using support vector machine,” Computer-Aided Civil and Infrastructure Engineering, vol. 34, pp. 991–1009, 2019.
[14] B. Yu, H. Wang, W. Shan, and B. Yao, “Prediction of bus travel time using random forests based on near neighbors,” Computer-Aided Civil and Infrastructure Engineering, vol. 33, pp. 333–350, 2018.
[15] S. Shetty, S. Shetty, C. Singh, and A. Rao, “Supervised machine learning: Algorithms and applications,” in Fundamental and Methods of Machine and Deep Learning: Algorithms, Tools and Applications. Hoboken, NJ, USA: Wiley, pp. 1–16, 2022.
[16] H. Abbasi, L. Bennet, J. Guann, and C. Unsworth, “Latent phase detection of hypoxic-ischemic spike transients in the EEG of preterm fetal sheep using reverse biorthogonal wavelets and fuzzy classifier,” International Journal of Neural Systems, vol. 29, pp. 195–212, 2019.
[17] J. Quinlan, “Introduction of decision trees,” Machine Learning, vol. 1, pp. 81–106, 1986.
[18] E. Lopez-Rubio, E. Molina-Cabello, M. Lique-Baena, and E. Dominguez, “Foreground detection by competitive learning for varying input distributions,” International Journal of Neural Systems, vol. 28, pp. 175–191, 2018.
[19] Z. Chen and C. Liu, “Roadway asset inspection sampling using high-dimensional clustering and locality-sensitivity hashing,” Computer-Aided Civil and Infrastructure Engineering, vol. 34, pp. 116–129, 2019.
[20] W. Tramel, M. Gabrie, A. Manoel, F. Caltagirone, and F. Krzakala, “Deterministic and generalized framework for unsupervised learning with restricted Boltzmann machines,” Physical Review X, vol. 8, 041006, 2018.
[21] A. Marugan, “Applications of reinforcement learning for maintenance of engineering systems: A review,” Advances in Engineering Software, vol. 183, pp. 103–117, 2023.
[22] J. Park and J. Park, “Enhanced machine learning algorithms: Deep learning, reinforcement learning and Q-learning,” Journal of Information Processing Systems, vol. 16, pp. 1001–1007, 2020.
[23] J. Abdi and B. Moshiri, “Application of temporal difference learning rules in short-term traffic flow prediction,” Expert Systems, vol. 32, pp. 49–64, 2015.
[24] T. Ahmad and H. Chen, “Deep learning for multi-scale smart energy forecasting,” Energy, vol. 175, pp. 98–112, 2019.
[25] C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
[26] R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed. Cambridge, MA, USA: MIT Press, 2018.
[27] T. Jiang, J. L. Gradus, and A. Rosellini, “Supervised machine learning: A brief primer,” Behavior Therapy, vol. 51, pp. 675–687, 2020.
[28] A. Singh, N. Thakur, and A. Sharma, “A review of supervised machine learning algorithms,” International Journal of Computer Applications, vol. 3, pp. 16–32, 2016.
[29] Y. Osisanwo, T. Akinsola, O. Awodele, O. Hinmikaiye, O. Olakanmi, and J. Akinjobi, “Supervised machine learning algorithms: Classification and comparison,” International Journal of Computer Trends and Technology, vol. 48, pp. 128–138, 2017.
[30] B. Kotsiantis, L. Zaharakis, and P. Pintelas, “Supervised machine learning: A review of classification techniques,” in Emerging Artificial Intelligence Applications in Computer Engineering, vol. 160, pp. 3–24, 2007.
[31] M. Belavagi and B. Muniyal, “Performance evaluation of supervised machine learning algorithms for intrusion detection,” Procedia Computer Science, vol. 89, pp. 117–123, 2016.
[32] E. Kim, W. Kim, and Y. Lee, “Combination of multiple classifiers for the customers purchase behavior prediction,” Decision Support Systems, vol. 34, pp. 167–175, 2003.
[33] J. Huang, Y. Li, and M. Xie, “An empirical analysis of data preprocessing for machine learning-based software cost estimation,” Information and Software Technology, vol. 67, pp. 108–127, 2015.
[34] T. Miseta, A. Fodor, and A. Vathy-Fogarassy, “Surpassing early stopping: A novel correlation-based stopping criterion for neural networks,” Neurocomputing, vol. 567, p. 127028, 2024.
[35] U. Ahmed, R. Momtaz, H. Anwar, A. Shan, R. Irfan, and J. Nieto, “Efficient water quality prediction using supervised machine learning,” Water, vol. 11, p. 2210, 2019.
[36] A. Fernandez, J. Bella, and J. Dorronsoro, “Supervised outlier detection for classification and regression,” Neurocomputing, vol. 486, pp. 77–92, 2022.
[37] M. Praveena and V. Jaiganesh, “A literature review on supervised machine learning algorithms and boosting process,” International Journal of Computer Applications, vol. 169, pp. 975–988, 2017.
[38] J. Jaccard, C. Wan, and R. Turrisi, “The detection and interpretation of interaction effects between continuous variables in multiple regression,” Multivariate Behavioral Research, vol. 25, pp. 467–478, 1990.
[39] A. Bahnsen, D. Aouada, and B. Ottersten, “Dependent cost-sensitive decision trees,” Expert Systems with Applications, vol. 42, pp. 6609–6619, 2015.
[40] D. Maulud and A. Abdulazez, “A review on linear regression comprehensive in machine learning,” Journal of Applied Science and Technology Trends, vol. 1, pp. 140–147, 2020.
[41] V. Utkin and Y. Zhuk, “A one-class classification support vector machine model by interval-valued training data,” Knowledge-Based Systems, vol. 120, pp. 43–56, 2017.
[42] C. Castillo-Botón, D. Casillas-Pérez, C. Casanova-Mateo, S. Ghimire, E. Cerro-Prada, P. Gutierrez, R. Deo, and S. Salcedo-Sanz, “Machine learning regression and classification methods for fog events prediction,” Atmospheric Research, vol. 272, p. 106157, 2022.
[43] S. Wojtowytsch, “Stochastic gradient descent with noise of machine learning type I: Discrete time analysis,” Journal of Nonlinear Science, vol. 33, p. 45, 2023.
[44] B. T. Polyak, “Some methods of speeding up the convergence of iteration methods,” USSR Computational Mathematics and Mathematical Physics, vol. 4, pp. 1–17, 1964.
[45] Y. Peng and W. Lee, “Practical guidelines for resolving the loss divergence caused by the root-mean-squared propagation optimizer,” Applied Soft Computing, vol. 153, pp. 13–37, 2024.
[46] S. Lloyd, M. Mohseni, and P. Rebentrost, “Quantum algorithms for supervised and unsupervised machine learning,” International Journal of Quantum Information, vol. 3, pp. 17–32, 2013.
[47] T. Hofmann, “Unsupervised learning by probabilistic latent semantic analysis,” Machine Learning, vol. 42, pp. 177–196, 2001.
[48] K. Sinaga and M. Yang, “Unsupervised K-means clustering algorithm,” IEEE Access, vol. 8, pp. 80716–80727, 2020.
[49] S. Mathias and R. Slager, “Unsupervised machine learning and band topology,” Physical Review Letters, vol. 124, pp. 226–241, 2020.
[50] D. Ernst, P. Geurts, and L. Wehenkel, “Tree-based batch mode reinforcement learning,” Journal of Machine Learning Research, vol. 6, pp. 503–556, 2005.
[51] L. J. Lin, “Self-improving reactive agents based on reinforcement learning, planning and teaching,” Machine Learning, vol. 8, pp. 293–321, 1992.
[52] M. Riedmiller, “Concepts and facilities of a neural reinforcement learning control architecture for technical process control,” Neural Computing and Applications, vol. 8, pp. 323–338, 2000.
[53] A. Agarwal, S. Kakade, J. Lee, and G. Mahajan, “On the theory of policy gradient methods: Optimality, approximation and distribution shift,” Journal of Machine Learning Research, vol. 22, pp. 1–76, 2021.
[54] A. Aswani, H. Gonzalez, S. S. Sastry, and C. Tomlin, “Provably safe and robust learning-based model predictive control,” Automatica, vol. 49, pp. 1216–1226, 2013.
[55] M. G. Azar, R. Munos, and H. J. Kappen, “Minimax bounds on the sample complexity of reinforcement learning with a generative model,” Machine Learning, vol. 91, pp. 325–349, 2013.
[56] E. Alpaydin, Introduction to Machine Learning. Cambridge, MA, USA: MIT Press, 2020.
[57] N. Ahmed, A. F. Atiya, N. E. Gayar, and H. El-Shishiny, “An empirical comparison of machine learning models for time series forecasting,” Econometric Reviews, vol. 29, pp. 594–621, 2010.
[58] R. Carbonneau, K. Laframboise, and R. Vahidov, “Application of machine learning techniques for supply chain demand forecasting,” European Journal of Operational Research, vol. 184, pp. 1140–1154, 2008.
[59] J. Ghaboussi, J. H. Garrett Jr., and X. Wu, “Knowledge-based modeling of material behavior with neural networks,” Journal of Engineering Mechanics, vol. 117, pp. 132–153, 1991.
[60] S. Trent, J. Renno, S. Sassi, and S. Mohamed, “Using image processing techniques in computational mechanics,” Computers & Mathematics with Applications, vol. 136, pp. 1–24, 2023.
[61] G. Capuano and J. J. Rimoli, “Smart finite elements: A novel machine learning application,” Computer Methods in Applied Mechanics and Engineering, vol. 345, pp. 363–381, 2019.
[62] M. Nashed, J. Renno, and S. Mohamed, “Nonlinear analysis of shell structures using image processing and machine learning,” Advances in Engineering Software, vol. 176, p. 103392, 2023.
[63] M. Cabrera, J. Ninic, and W. Tizani, “Fusion of experimental and synthetic data for reliable prediction of steel connection behaviour using machine learning,” Engineering Computations, vol. 39, pp. 3993–4011, 2023.
[64] O. Bolaji, H. M., A. Krishnan, and S. Das, “Integrating experiments, finite element analysis, and interpretable machine learning to evaluate the auxetic response of 3D printed re-entrant metamaterials,” Journal of Materials Research and Technology, vol. 25, pp. 1612–1625, 2023.
[65] S. Koutsourelakis, “Stochastic upscaling in solid mechanics: An exercise in machine learning,” Journal of Computational Physics, vol. 226, pp. 301–325, 2007.
[66] H. Lees and S. Kang, “Neural algorithm for solving differential equations,” Journal of Computational Physics, vol. 91, pp. 110–131, 1990.
[67] W. E, J. Han, and A. Jentzen, “Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations,” Communications in Mathematics and Statistics, vol. 5, pp. 349–380, 2017.
[68] M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational Physics, vol. 378, pp. 686–707, 2019.
[69] V. Badarinath, M. Chierichetti, and F. Kakhki, “A machine learning approach as a surrogate for a finite element analysis: Status of research and application to one-dimensional systems,” Sensors, vol. 21, p. 1654, 2021.
[70] A. Hashemi, J. Jang, and J. Beheshti, “A machine learning-based surrogate finite element model for estimating dynamic response of mechanical systems,” IEEE Access, vol. 11, pp. 54509–54525, 2023.
[71] C. Farrar and K. Worden, “An introduction to structural health monitoring,” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol. 365, pp. 303–315, 2007.
[72] J. Brownjohn, “Structural health monitoring of civil infrastructure,” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol. 365, pp. 589–622, 2007.
[73] J. Wagg, K. Worden, R. Barthorpe, and P. Gardner, “Digital twins: State-of-the-art and future directions for modeling and simulation in engineering dynamics applications,” ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part B: Mechanical Engineering, vol. 6, p. 030901, 2020.
[74] K. Worden and G. Manson, “The application of machine learning to structural health monitoring,” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol. 365, pp. 515–537, 2007.
[75] P. González and L. Zapico, “Seismic damage identification in buildings using neural networks and modal data,” Computers & Structures, vol. 86, pp. 416–426, 2008.
[76] P. Gardner, L. Bull, N. Dervilis, and K. Worden, “On the application of kernelised Bayesian transfer learning to population-based structural health monitoring,” Mechanical Systems and Signal Processing, vol. 167, p. 108519, 2022.
[77] M. Taylor and P. Stone, “Transfer learning for reinforcement learning domains: A survey,” Journal of Machine Learning Research, vol. 10, pp. 1633–1685, 2009.
[78] P. Pizarro and L. Massone, “Structural design of reinforced concrete buildings based on deep neural networks,” Engineering Structures, vol. 241, p. 112377, 2021.
[79] S. Chaillou, “Archigan: Artificial intelligence × architecture,” in Architectural Intelligence: Selected Papers from the 1st International Conference on Computational Design and Robotic Fabrication (CDRF 2019). Berlin, Germany: Springer, pp. 117–127, 2020.
[80] W. Liao, X. Lu, Y. Huang, Z. Zheng, and Y. Lin, “Automated structural design of shear wall residential buildings using generative adversarial networks,” Automation in Construction, vol. 132, p. 103931, 2021.
[81] P. Charalampous, “Prediction of cutting forces in milling using machine learning algorithms and finite element analysis,” Journal of Materials Engineering and Performance, vol. 30, pp. 2002–2012, 2002.
[82] O. Jirousek, P. Palar, J. Falta, and Y. Dwianto, “Design exploration of additively manufactured chiral auxetic structure using explainable machine learning,” Materials & Design, vol. 232, p. 112128, 2023.
[83] W. Yan, L. Deng, F. Zhang, T. Li, and S. Li, “Probabilistic machine learning approach to bridge fatigue failure analysis due to vehicular overloading,” Engineering Structures, vol. 193, pp. 91–99, 2019.
[84] J. Reiner, N. Linden, R. Vaziri, N. Zobeiry, and B. Kramer, “Bayesian parameter estimation for the inclusion of uncertainty in progressive damage simulation of composites,” Composite Structures, vol. 321, p. 117257, 2023.
[85] S. Kan, C. Tan, and J. Mathew, “A review on prognostic techniques for non-stationary and non-linear rotating systems,” Mechanical Systems and Signal Processing, vol. 62, pp. 1–20, 2015.
[86] Y. M. A. Hashash, S. Jung, and J. Ghaboussi, “Numerical implementation of a neural network-based material model in finite element analysis,” International Journal for Numerical Methods in Engineering, vol. 59, pp. 989–1005, 2004.
[87] A. Carneiro, A. Alves, R. Coelho, J. Cardoso, and F. Pires, “A simple machine learning-based framework for faster multi-scale simulations of path-independent materials at large strains,” Finite Elements in Analysis and Design, vol. 222, p. 103956, 2023.
[88] J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA, USA: MIT Press, pp. 358–388, 2018.
[89] D. Hein, S. Udluft, and A. Runkler, “Interpretable policies for reinforcement learning by genetic programming,” Engineering Applications of Artificial Intelligence, vol. 76, pp. 158–167, 2018.
[90] B. Hashem and I. Zahidul, “Advantages and limitations of genetic algorithms for clustering records,” in Proc. IEEE 11th Conf. Industrial Electronics and Applications (ICIEA), Hefei, China, Jun. 5–7, pp. 2478–2483, 2016.
[91] B. Ghojogh, M. Crowley, F. Karray, and A. Ghodsi, “Locally linear embedding,” in Elements of Dimensionality Reduction and Manifold Learning. Cham, Switzerland: Springer, vol. 404, pp. 207–247, 2023.
[92] A. McCallum, K. Nigam, J. Rennie, and K. Seymore, “A machine learning approach to building domain-specific search engines,” in Proc. Int. Joint Conf. Artificial Intelligence (IJCAI), Stockholm, Sweden, Jul.–Aug. pp. 662–667, 1999.
[93] J. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proc. 5th Berkeley Symp. Mathematical Statistics and Probability, Berkeley, CA, USA, pp. 281–297, 1967.
[94] J. H. Friedman and P. Langley, “Estimating continuous distributions in Bayesian classifiers,” in Proc. 11th Conf. Uncertainty in Artificial Intelligence, Montreal, QC, Canada, Aug. 1995, pp. 338–345.
[95] L. K. Saul and S. T. Roweis, “Unsupervised learning of two-dimensional manifolds,” Journal of Machine Learning Research, vol. 4, pp. 119–155, 2003.
[96] L. Bo, X. Ren, and D. Fox, “Unsupervised feature learning for RGB-D based object recognition,” in Experimental Robotics: The 13th International Symposium on Experimental Robotics. Berlin, Germany: Springer, 2013, pp. 387–402.
[97] M. Daneshvar and S. Hassan, “Unsupervised learning-based damage assessment of full-scale civil structures under long-term and short-term monitoring,” Engineering Structures, vol. 256, p. 114059, 2022.
[98] M. F. Ashby and D. R. H. Jones, Sustainable Materials. Cambridge, U.K.: UIT Cambridge Ltd., 2012, vol. 2, pp. 51–54.
[99] J. Choi, N. Kim, and Y. Hong, “Unsupervised Legendre–Galerkin neural network for solving partial differential equations,” IEEE Access, vol. 11, pp. 23433–23446, 2023.
[100] P. Rizzo, M. Cammarata, D. Dutta, H. Sohn, and K. Harries, “An unsupervised learning algorithm for fatigue crack detection in waveguides,” Smart Materials and Structures, vol. 18, p. 025016, 2009.
[101] J. Pan, J. Huang, Y. Wang, G. Cheng, and Y. Zeng, “A self-learning finite element extraction system based on reinforcement learning,” AI EDAM, vol. 35, pp. 180–208, 2021.
[102] S. Eslami, S. Eslami, D. Sen, and S. Pradhan, “Active structural control framework using policy-gradient reinforcement learning,” Engineering Structures, vol. 274, p. 115122, 2023.
[103] S. Narvekar, N. Patel, R. Upadhyay, and K. George, “Comparison of reinforcement learning algorithms applied to the cart-pole problem,” in Proc. Int. Conf. Advances in Computing, Communications and Informatics (ICACCI), Udupi, India, Sept. 13–16, 2017, pp. 26–32.
[104] S. Kazem and M. Javad, “Application of reinforcement learning algorithm for automation of canal structures,” Irrigation and Drainage, vol. 64, pp. 77–84, 2015.
[105] Z.-C. Qiu, G.-H. Chen, and X.-M. Zhang, “Reinforcement learning vibration control for a flexible hinged plate,” Aerospace Science and Technology, vol. 118, p. 107056, 2021.
[106] L. Yi, X. Deng, L. T. Yang, H. Wu, M. Wang, and Y. Situ, “Reinforcement-learning-enabled partial confident information coverage for IoT-based bridge structural health monitoring,” IEEE Internet of Things Journal, vol. 8, pp. 3108–3119, 2020.
[107] A. Kaveh, M. Salimi, and M. Khodadadi, “Online control of an active seismic system via reinforcement learning,” Structural Control and Health Monitoring, vol. 26, p. e2298, 2019.
[108] C. Zimmerling, C. Poppe, O. Stein, and L. Kärger, “Optimisation of manufacturing process parameters for variable component geometries using reinforcement learning,” Materials & Design, vol. 214, p. 110423, 2022.
[109] O. Harley, Y. Li, M. K. Gupta, M. W. Newman, and M. R. Cutkosky, “Reinforcement learning for facilitating human–robot interaction in manufacturing,” Journal of Manufacturing Systems, vol. 56, pp. 326–340, 2020.
[110] J. Viquerat, J. Rabault, A. Kuhnle, H. Ghraieb, A. Larcher, and E. Hachem, “Direct shape optimization through deep reinforcement learning,” Journal of Computational Physics, vol. 428, p. 110080, 2021.
[111] S. Dias, S. Givigi, and C. Neves, “Autonomous construction of structures in a dynamic environment using reinforcement learning,” in Proc. IEEE Int. Systems Conf. (SysCon), Orlando, FL, USA, Apr. 15–18, 2013, pp. 452–459.
[112] K. Dantas, I. Oliveira, D. Duarte, A. Guedes, M. Santos, and A. Brandão, “Q-learning based path planning method for UAVs using priority shifting,” in Proc. Int. Conf. Unmanned Aircraft Systems (ICUAS), Dubrovnik, Croatia, Jun. 21–24, 2022, pp. 421–426.
[113] F. Döpp, S. Diermeier, M. Wimmer, B. Schleich, and S. Wartzack, “Reinforcement learning for engineering design automation,” Advanced Engineering Informatics, vol. 52, p. 101612, 2022.
[114] M. O. Ryll and G. W. Fischer, “Design synthesis of structural systems as a Markov decision process solved with deep reinforcement learning,” Journal of Mechanical Design, vol. 145, p. 061701, 2023.
[115] X. Guan, Z. Xiang, Y. Bao, and H. Li, “Structural dominant failure modes searching method based on deep reinforcement learning,” Reliability Engineering & System Safety, vol. 219, p. 108258, 2022.
[116] J. Dahmen, L. Mertens, S. Zimmermann, T. Igel, N. Lohse, and D. Hübner, “Deep reinforcement learning methods for structure-guided processing path optimization,” Journal of Intelligent Manufacturing, vol. 33, pp. 333–352, 2022.
[117] M. Roberson, K. Inman, A. Carey, I. Howard, and J. Shannon, “Probabilistic neural networks that predict compressive strength of high strength concrete in mass placements using thermal history,” Computers & Structures, vol. 259, p. 106707, 2022.
[118] F. Yan, Y. Gu, Y. Wang, C. M. Wang, X. Y. Hu, H. X. Peng, et al., "Study on the interaction mechanism between laser and rock during perfo 2, ration," Optics and Laser Technology, vol. 54, no.2, pp. 303-308, Dec 2013.
[119] L. Liu and H. Miao, "A specification-based approach to testing polymorphic attributes," in Formal Methods and Software Engineering: Proceedings of the 6th International Conference on Formal Engineering Methods, ICFEM 2004, Seattle, WA, USA, November 8-12, 2004, J. Davies, W. Schulte, M. Barnett, Eds. Berlin: Springer, 2004. pp. 306-19.
[120] M.R. Brooks, “Musical toothbrush with adjustable neck and mirror,” U.S Patent 326189 [Online],
[121] J. O. Williams, “Narrow-band analyzer,” Ph.D. dissertation, Dept. Elect. Eng., Harvard Univ., Cambridge, MA, 1993.
[122] B. Klaus and P. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.