Anomaly Detection on AWS cloud by using Supervised Machine Learning

##plugins.themes.academic_pro.article.main##

Tasmi Jasani
Mukti Padhya

Abstract

Cloud security has gained widespread popularity across various industries due to a variety of services that offer improved functionality, scalability, and affordability. However, the security of cloud environments has become increasingly critical due to the increasing number of attacks. Traditional methods of security monitoring often rely on predefined rules and thresholds which may not adapt well to evolving threats or complex attack patterns. An approach for detecting anomalies in the cloud by analyzing patterns in AWS (Amazon Web Service) CloudTrail logs has been presented. Although there are other cloud service providers available, AWS is chosen for anomaly detection due to its popularity. Analyzing such a vast number of logs without automation is complex, and detecting anomalies within this large dataset is a crucial task. Artificial intelligence (AI) is chosen for this task because it can spot patterns and anomalies that are too difficult to find manually, making detection more accurate and efficient. This paper examines the various supervised and unsupervised machine learning for accurate anomaly detection. By automating this process, the system aims to provide real-time alerts, enabling prompt responses to potential issues. The performance of the system is evaluated using metrics like precision, recall, and accuracy score. Our results demonstrate 97% detection accuracy. The results indicate that the proposed solution can effectively identify anomalies with high precision, demonstrating its potential to improve cloud security and operational management.

Keywords:

Cloud computing, Artificial intelligence, Anomaly Detection, AWS Cloud

##plugins.themes.academic_pro.article.details##

How to Cite
Jasani, T., & Padhya, M. . (2025). Anomaly Detection on AWS cloud by using Supervised Machine Learning. International Journal of Next-Generation Computing, 16(1). https://doi.org/10.47164/ijngc.v16i1.1837

References

  1. Abdulsalam, Y. S. and Hedabou, M. 2021. Security and privacy in cloud computing: technical review Future Internet 14, 1, 11. DOI: https://doi.org/10.3390/fi14010011
  2. Al-Mazrawe, A. and Al-Musawi, B. 2024. Anomaly detection in cloud network: A review. In BIO Web of Conferences. Vol. 97. EDP Sciences, 00019. DOI: https://doi.org/10.1051/bioconf/20249700019
  3. Ali, M., Khan, S. U., and Vasilakos, A. V. 2015. Security in cloud computing: Opportunities and challenges. Information sciences 305, 357–383. DOI: https://doi.org/10.1016/j.ins.2015.01.025
  4. Arapidis, E. 2024. Optimized fpga implementation for random forests for anomaly detection.
  5. Arjunan, T. 2024. A comparative study of deep neural networks and support vector machines for unsupervised anomaly detection in cloud computing environments. International Journal for Research in Applied Science and Engineering Technology 12, 9, 10–22214. DOI: https://doi.org/10.22214/ijraset.2024.58496
  6. Atuluku, A., Osang, F., and Adebiyi, A. 2022. Cloud computing adoption and use: A systematic review. Advances in Multidisciplinary and scientific Research Journal Publication 13, 4, 29–64. DOI: https://doi.org/10.22624/AIMS/CISDI/V13N4P3
  7. Byrne, D., Corrado, C., and Sichel, D. E. 2018. The rise of cloud computing: minding your p’s, q’s and k’s. Tech. rep., National Bureau of Economic Research. DOI: https://doi.org/10.3386/w25188
  8. Hagemann, T. and Katsarou, K. 2020. A systematic review on anomaly detection for cloud computing environments. In Proceedings of the 2020 3rd Artificial Intelligence and Cloud Computing Conference. 83–96. DOI: https://doi.org/10.1145/3442536.3442550
  9. Hassan, J., Shehzad, D., Habib, U., Aftab, M. U., Ahmad, M., Kuleev, R., and Mazzara, M. 2022. The rise of cloud computing: Data protection, privacy, and open research challenges—a systematic literature review (slr). Computational intelligence and neuroscience 2022, 1, 8303504. DOI: https://doi.org/10.1155/2022/8303504
  10. Islam, M. S., Pourmajidi, W., Zhang, L., Steinbacher, J., Erwin, T., and Miranskyy, A. 2021. Anomaly detection in a large-scale cloud platform. In 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). IEEE, 150–159. DOI: https://doi.org/10.1109/ICSE-SEIP52600.2021.00024
  11. Jabbar, J., Mehmood, H., and Malik, H. 2020. Security of cloud computing: belongings for the generations. International Journal of Engineering & Technology 9, 2, 454–457. DOI: https://doi.org/10.14419/ijet.v9i2.30396
  12. Mitropoulou, K., Kokkinos, P., Soumplis, P., and Varvarigos, E. 2024. Anomaly detection in cloud computing using knowledge graph embedding and machine learning mechanisms. Journal of Grid Computing 22, 1, 6. DOI: https://doi.org/10.1007/s10723-023-09727-1
  13. Prakash, N., Vignesh, J., Ashwin, M., Ramadass, S., Veeranjaneyulu, N., Athawale, S. V., Ravuri, A., and Subramanian, B. 2024. Retracted article: Enabling secure and efficient industry 4.0 transformation through trust-authorized anomaly detection in cloud environments with a hybrid ai approach. Optical and Quantum Electronics 56, 2, 251. DOI: https://doi.org/10.1007/s11082-023-05781-x
  14. Primartha, R. and Tama, B. A. 2017. Anomaly detection using random forest: A performance revisited. In 2017 International conference on data and software engineering (ICoDSE). IEEE, 1–6. DOI: https://doi.org/10.1109/ICODSE.2017.8285847
  15. Salman, T., Bhamare, D., Erbad, A., Jain, R., and Samaka, M. 2017. Machine learning for anomaly detection and categorization in multi-cloud environments. In 2017 IEEE 4th international conference on cyber security and cloud computing (CSCloud). IEEE, 97–103. DOI: https://doi.org/10.1109/CSCloud.2017.15
  16. Tian, Q., Tang, H., and Wang, X. 2024. A weakly supervised learning approach to anomaly detection on cloud server configuration. International Journal of Sciences 13, 07, 41–51. DOI: https://doi.org/10.18483/ijSci.2779