ExPSO-DL: An Exponential Particle Swarm Optimization Package for Deep Learning Model Optimization
References
- Kraidia I, Ghenai A, Zeghib N.
HST-Detector: A Multimodal Deep Learning System for Twitter Spam Detection . In: Computational Intelligence, Data Analytics and Applications, vol. 643, Cham; 2023. pp. 91–103. DOI: 10.1007/978-3-031-27099-4_8 - Kraidia I, Ghenai A, Zeghib N. A Multimodal Spam Filtering System for Multimedia Messaging Service. In: International Conference on Artificial Intelligence Science and Applications (CAISA), vol. 1441, Cham; 2023. pp. 121–131. DOI: 10.1007/978-3-031-28106-8_9
- Kraidia I, Ghenai A, Belhaouari SB. A Multi-Faceted Approach to Trending Topic Attack Detection Using Semantic Similarity and Large-Scale Datasets. IEEE Access. 2025;13:21005–21028. DOI: 10.1109/ACCESS.2025.3535996
- Abualhaj MM, Al-Shamayleh AS, Munther A, Alkhatib SN, Hiari MO, Anbar M. Enhancing spyware detection by utilizing decision trees with hyperparameter optimization. Bulletin EEI. Oct. 2024.13(5):3653–3662. DOI: 10.11591/eei.v13i5.7939
- Kraidia I, Ghenai A, Belhaouari SB. Defense against adversarial attacks: robust and efficient compressed optimized neural networks. Scientific Reports. Mar. 2024.14(1):6420. DOI: 10.1038/s41598-024-56259-z
- Liu W, Wang Z, Yuan Y, Zeng N, Hone K, Liu X. A Novel Sigmoid-Function-Based Adaptive Weighted Particle Swarm Optimizer. IEEE Trans. Cybern. Feb. 2021.51(2):1085–1093. DOI: 10.1109/TCYB.2019.2925015
- Chen K, Zhou F, Wang Y, Yin L. An ameliorated particle swarm optimizer for solving numerical optimization problems. Applied Soft Computing. Dec. 2018.73:482–496. DOI: 10.1016/j.asoc.2018.09.007
- Tian D, Zhao X, Shi Z. Chaotic particle swarm optimization with sigmoid-based acceleration coefficients for numerical function optimization. Swarm and Evolutionary Computation. Dec. 2019.51:100573. DOI: 10.1016/j.swevo.2019.100573
- Raza A, et al. Multi-Objective Optimization of VSC Stations in Multi-Terminal VSC-HVdc Grids, Based on PSO. IEEE Access. 2018;6:62995–63004. DOI: 10.1109/ACCESS.2018.2875972
- Yang J, Wang X, Bauer P. Extended PSO Based Collaborative Searching for Robotic Swarms With Practical Constraints. IEEE Access. 2019;7:76328–76341. DOI: 10.1109/ACCESS.2019.2921621
- Rauf HT, Shoaib U, Lali MI, Alhaisoni M, Irfan MN, Khan MA. Particle Swarm Optimization With Probability Sequence for Global Optimization. IEEE Access. 2020;8:110535–110549. DOI: 10.1109/ACCESS.2020.3002725
- Xia X, et al. A fitness-based multi-role particle swarm optimization. Swarm and Evolutionary Computation. Feb. 2019;44:349–364. DOI: 10.1016/j.swevo.2018.04.006
- Xia X, et al. An expanded particle swarm optimization based on multi-exemplar and forgetting ability. Information Sciences. Jan. 2020;508:105–120. DOI: 10.1016/j.ins.2019.08.065
- Sanjalawe Y, Al-E’mari S, Fraihat S, Abualhaj M, Alzubi E. A deep learning-driven multi-layered steganographic approach for enhanced data security. Sci Rep. Feb. 2025.15(1). DOI: 10.1038/s41598-025-89189-5
- Ghasemi M, Akbari E, Rahimnejad A, Razavi SE, Ghavidel S, Li L. Phasor particle swarm optimization: a simple and efficient variant of PSO. Soft Comput. Oct. 2019.23(19):9701–9718. DOI: 10.1007/s00500-018-3536-8
- Kassoul K, Zufferey N, Cheikhrouhou N, Belhaouari SB. Exponential Particle Swarm Optimization for Global Optimization. IEEE Access. 2022;10:78320–78344. DOI: 10.1109/ACCESS.2022.3193396
- Belhaouari SB, Kraidia I. Efficient self-attention with smart pruning for sustainable large language models. Sci Rep. Mar. 2025.15(1):10171. DOI: 10.1038/s41598-025-92586-5
- Kraidia I, Belhaouari SB. Towards Robust SEA Detection: Leveraging Model Diversity and Randomization Against Adversarial Attacks. In: 2025 12th International Conference on Information Technology (ICIT);
May 2025 . pp. 84–90. DOI: 10.1109/ICIT64950.2025.11049179 - Abadi M, et al. TensorFlow: A system for large-scale machine learning; May 31, 2016. arXiv: arXiv:1605.08695. DOI: 10.48550/arXiv.1605.08695
- Paszke A, et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library; Dec. 03, 2019. arXiv: arXiv:1912.01703. DOI: 10.48550/arXiv.1912.01703
- Emiola I, Adem R. Comparison of Minimization Methods for Rosenbrock Functions; Apr. 23, 2021. arXiv: arXiv:2101.10546. DOI: 10.1109/MED51440.2021.9480200
- Joseph FJJ, Nonsiri S, Monsakul A.
Keras and TensorFlow: A Hands-On Experience . In: Prakash KB, Kannan R, Alexander SA, Kanagachidambaresan GR, editors. Advanced Deep Learning for Engineers and Scientists. In EAI/Springer Innovations in Communication and Computing. Cham: Springer International Publishing; 2021. pp. 85–111. DOI: 10.1007/978-3-030-66519-7_4 - Frostig R, Johnson MJ, Leary C. Compiling machine learning programs via high-level tracing.
- Groot RD, Van Der Eerden JP, Faber NM. The direct correlation function in hard sphere fluids. The Journal of Chemical Physics. Aug. 1987.87(4):2263–2270. DOI: 10.1063/1.453155
- Bäck T, Schwefel H-P. An Overview of Evolutionary Algorithms for Parameter Optimization. Evolutionary Computation, Mar. 1993.1(1):1–23. DOI: 10.1162/evco.1993.1.1.1
- Kyurkchiev N, Markov S. On the Hausdorff distance between the Heaviside step function and Verhulst logistic function. J Math Chem. Jan. 2016.54(1):109–119. DOI: 10.1007/s10910-015-0552-0
- Pinnau R, Totzeck C, Tse O, Martin S. A consensus-based model for global optimization and its mean-field limit. Math. Models Methods Appl. Sci. Jan. 2017.27(01):183–204. DOI: 10.1142/S0218202517400061
- Locatelli M. A Note on the Griewank Test Function. Journal of Global Optimization, Feb. 2003.25(2):169–174. DOI: 10.1023/A:1021956306041
- Ivanescu AE, Staicu A-M, Scheipl F, Greven S. Penalized function-on-function regression. Computational Statistics. June 2015.30(2)539–568. DOI: 10.1007/s00180-014-0548-4
- Liu X-R, Pawitan Y, Clements M. Parametric and penalized generalized survival models. Statistical Methods in Medical Research. 2018;27(5):1531–1546. DOI: 10.1177/0962280216664760
- Prasanth D. Design and Analysis of Pressure Vessel.
- Paredes M, Sartor M, Masclet C. Obtaining an optimal compression spring design directly from a user specification. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture. Mar. 2002.216(3):419–428. DOI: 10.1243/0954405021519906
- The Commonwealth Scientific and Industrial Research Organisation. Current Biology. Mar. 1997;7(3):R126. DOI: 10.1016/S0960-9822(97)70976-X
- Mehmood R, Qazi MH, Ata H, Zaheer R. Golinski’s Speed Reducer Problem Revisited Using Genetic Algorithm. 2016;16(1).
- Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proc. IEEE. Nov. 1998; 86(11):2278–2324. DOI: 10.1109/5.726791
- Hochreiter S, Schmidhuber J. Long Short-Term Memory. Neural Computation. Nov. 1997.9(8):1735–1780. DOI: 10.1162/neco.1997.9.8.1735
- Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov R, Le QV. XLNet: Generalized Autoregressive Pretraining for Language Understanding; Jan. 02, 2020. arXiv: arXiv:1906.08237. DOI: 10.48550/arXiv.1906.08237.
- Costin A, Isacenkova J, Balduzzi M, Francillon A, Balzarotti D. The role of phone numbers in understanding cyber-crime schemes. In: 2013 Eleventh Annual Conference on Privacy, Security and Trust, Tarragona, Spain:
IEEE ;July 2013 . pp. 213–220. DOI: 10.1109/PST.2013.6596056 - Simonyan K, Zisserman A. Very Deep Convolutional Networks for Large-Scale Image Recognition; Apr. 10, 2015. arXiv: arXiv:1409.1556. DOI: 10.48550/arXiv.1409.1556.
- Deng L. The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]. IEEE Signal Processing Magazine. 2012;29(6):pp. 141–142. DOI: 10.1109/MSP.2012.2211477
- Bahraminasr M, Sadr AV. IMDb data from Two Generations, from 1979 to 2019; Part one, Dataset Introduction and Preliminary Analysis; Sept. 06, 2020. arXiv: arXiv:2005.14147. DOI: 10.48550/arXiv.2005.14147.
DOI: https://doi.org/10.5334/jors.521 | Journal eISSN: 2049-9647
Language: English
Submitted on: Jun 18, 2024
Accepted on: Sep 27, 2025
Published on: Nov 11, 2025
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
© 2025 Insaf Kraidia, Khelil Kassoul, Naoufel Cheikhrouhou, Saima Hassan, Samir Brahim Belhaouari, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.