Intelligent Data Automation in E-Commerce
Keywords:
Artificial intelligence; data engineering; data engineering automation; data pipeline; e-commerce; intelligent data processing.Abstract
The role of data engineering in e-commerce systems is critical, especially for personalization, product recommendations, dynamic pricing, and demand forecasting. Conventional data engineering relies on large amounts of manual effort, making it challenging to keep pace with rapidly changing data and application requirements. The application of AI techniques to data pipelines in e-commerce is an active area of research and practice. Such application offers the prospect of greater automation of data engineering, similar to the role of CI/CD and MLOps for software and machine-learning model development. The work summarizes concepts relating to the use of AI techniques in data processing and engineering, thereby extending the scope of AI beyond traditional product systems and closer to the data pipelines themselves. Functionally significant e-commerce application areas are highlighted, with an emphasis on personalization systems.
Several emerging architectural patterns in e-commerce, including data meshes, federated learning, privacy-preserving computation, and observability tools, are introduced. These patterns encapsulate concepts that support the deployment and operationalization of AI-driven data-granularity pipelines. Recent research also emphasizes how the application of AI techniques helps capture ever-changing data conditions and customer needs. Academic work proposes measures that can be applied across data pipelines to provide insights about data drift—an accelerated shift in data characteristics that leads to decreased model quality. Practical challenges in real-time usage together with opportunities for the further development of AI techniques in data engineering are also considered.
References
1. Alamdari, P. M., Navimipour, N. J., Hosseinzadeh, M., Safaei, A. A., & Darwesh, A. (2020). A systematic study on the recommender systems in the E-commerce. IEEE Access, 8, 115694–115716.
2. Marchand, A., & Marx, P. (2020). Automated product recommendations with preference-based explanations. Journal of Retailing, 96(3), 328–343.
3. Mangalampalli, B. M., Bandi, V. D. V. K., Kolla, S. K., & Kumar, M. V. K. (2025). Towards Self-Evolving Healthcare Intelligence: Integrating Advanced Learning Systems with Real-Time Clinical Data Pipelines. Cultura: International Journal of Philosophy of Culture and Axiology, 22(12s), 464-486.
4. Boratto, L., Fenu, G., & Marras, M. (2021). Connecting user and item perspectives in popularity debiasing for collaborative recommendation. Information Processing & Management, 58(1), 102387.
5. Cheng, X., Bao, Y., Zarifis, A., Gong, W., & Mou, J. (2022). Exploring consumers' response to text-based chatbots in e-commerce: The moderating role of task complexity and chatbot disclosure. Internet Research, 32(2), 496–517.
6. Kolla, S. K., & Reddy, V. A. R. (2024). Evaluating Cloud-Native vs. Hybrid Architectures for Health Benefit Administration Systems. International Journal of Medical Toxicology and Legal Medicine, 27(5), 1042-1053.
7. Policarpo, L. M., da Silveira, D. E., Righi, R. R., Stoffel, R. A., da Costa, C. A., Barbosa, J. L. V., Scorsatto, R., & Arcot, T. (2021). Machine learning through the lens of e-commerce initiatives: An up-to-date systematic literature review. Computer Science Review, 41, 100414.
8. Mahadevan, S. (2024). Intelligent Serverless Process Automation for Scalable Cloud Operations and Dynamic Resource Optimization. Journal of Computational Analysis and Applications (JoCAAA), 33(06), 4207-4221.
9. Zheng, J., Li, Q., & Liao, J. (2021). Heterogeneous type-specific entity representation learning for recommendations in e-commerce network. Information Processing & Management, 58(5), 102629.
10. Elahi, M., Kholgh, D. K., Kiarostami, M. S., Saghari, S., Rad, S. P., & Tkalčič, M. (2021). Investigating the impact of recommender systems on user-based and item-based popularity bias. Information Processing & Management, 58(5), 102655.
11. Mattaparthi, R. (2025). GenAI-Augmented Diagnostic Reasoning for Diesel Engine Fault Triage: A Large Language Model Framework for Technician Decision Support at Scale. Journal of Material Sciences & Manufacturing Research, 6(12), 1.
12. Zhao, Y., Wang, X., & Zhang, Y. (2021). IR-Rec: An interpretive rules-guided recommendation over knowledge graph. Information Sciences, 563, 326–341.
13. Bawack, R. E., Wamba, S. F., Carillo, K. D. A., & Akter, S. (2022). Artificial intelligence in E-Commerce: A bibliometric study and literature review. Electronic Markets, 32, 297–338.
14. Liu, L. (2022). E-commerce personalized recommendation based on machine learning technology. Mobile Information Systems, 2022, Article 1761579.
15. Mahadevan, S. (2025). DRIVING SUSTAINABILITY IN AUTO & MANUFACTURING SECTORS: THE ROLE OF CLOUD-BASED SERVERLESS AUTOMATION FOR ERP SYSTEMS. International Journal of Applied Mathematics, 38(7s), 1813-1825.
16. Festa, Y. Y., & Vorobyev, I. A. (2022). A hybrid machine learning framework for e-commerce fraud detection. Journal of Management Analytics, 17(1).
17. Li, J. (2022). E-commerce fraud detection model by computer artificial intelligence data mining. Computational Intelligence and Neuroscience, 2022, Article 8783783.
18. Loganathan, R. (2025). AGENTIC AI FRAMEWORKS FOR AUTONOMOUS RISK DETECTION AND COMPLIANCE REMEDIATION IN ENTERPRISE DATA CENTER OPERATIONS. Lex Localis-Journal of Local Self-Government, 23 (S6), 9672–9697.
19. Islek, I., & Oguducu, S. G. (2022). A hierarchical recommendation system for E-commerce using online user reviews. Electronic Commerce Research and Applications, 52, Article 101131.
20. Xu, L., & Sang, X. (2022). E-commerce online shopping platform recommendation model based on integrated personalized recommendation. Scientific Programming, 2022, Article 4823828.
21. Mangalampalli, B. M., Kolla, S. K., Bandi, V. D. V. K., Yandamuri, U. S., & Rani, P. S. (2025). Designing Intelligent Healthcare Ecosystems through Adaptive Data Integration and Autonomous Learning Systems. Vascular and Endovascular Review, 8(20s), 330-347.
22. Heins, C. (2023). Artificial intelligence in retail – A systematic literature review. Foresight, 25(2), 264–286.
23. Brackmann, C., Hütsch, M., & Wulfert, T. (2023). Identifying application areas for machine learning in the retail sector: A literature review and interview study. SN Computer Science, 4, Article 426.
24. Yadav, N. B. (2023). Harnessing customer feedback for product recommendations: An aspect-level sentiment analysis framework. Human-Centric Intelligent Systems, 3, 57–67.
25. Kolla, S. H., & Mangala, N. (2025). DESIGNING AUTONOMOUS LLM AGENT FRAMEWORKS USING GEN AI PIPELINES TO ENHANCE CUSTOMER SERVICE MANAGEMENT AND KNOWLEDGE WORKFLOWS. Lex Localis-Journal of Local Self-Government, 23, 9719-9733.
26. Choudhary, C., Singh, I., & Kumar, M. (2023). SARWAS: Deep ensemble learning techniques for sentiment based recommendation system. Expert Systems with Applications, 216, Article 119420.
27. Tang, Y. M., Chau, K. Y. G., Lau, Y. Y., & Zheng, Z. (2023). Data-intensive inventory forecasting with artificial intelligence models for cross-border E-commerce service automation. Applied Sciences, 13(5), Article 3051.
28. Zhang, Q., & Tan, Y. (2023). Data-driven E-commerce end-to-end inventory optimization algorithm. Fuzzy Systems and Data Mining IX.
29. Mangala, N., & Kolla, S. H. (2025). Real-Time Feature Engineering for Streaming AI Workloads Using PySpark and Azure Event Hubs. International Journal of Multidisciplinary Research in Science, Engineering, Technology & Management, 1(6), 93-105.
30. Qi, B., Shen, Y., & Xu, T. (2023). An artificial-intelligence-enabled sustainable supply chain model for B2C E-commerce business in the international trade. Technological Forecasting and Social Change, 197, Article 122491.
31. Latha, Y. M. (2024). Amazon product recommendation system based on a modified convolutional neural network. ETRI Journal.
32. Peng, B., Ling, X., Chen, Z., Sun, H., & Ning, X. (2024). eCeLLM: Generalizing large language models for E-commerce from large-scale, high-quality instruction data. Proceedings of the 41st International Conference on Machine Learning, 235, 40215–40257.
33. Mangalampalli, B. M., & Kolla, S. K. (2025). Large Language Models for Automated Healthcare Data Dictionary Generation and Maintenance. Vascular and Endovascular Review, 8(20s), 363-375.
34. Wang, Y., & Minner, S. (2024). Deep reinforcement learning for demand fulfillment in online retail. International Journal of Production Economics, 269, Article 109133.
35. Dritsas, E., & Trigka, M. (2025). Machine learning in E-commerce: Trends, applications, and future challenges. IEEE Access, 13, 99048–99067.
Additional Files
Published
Data Availability Statement
None
Issue
Section
License
Copyright (c) 2026 Olivia Johnson (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
