Apache Spark-Based Big Data Analytics on E-commerce Trends
Author(s): Ayushika Singh
Affiliation: Dept. Of Computer Science and Engineering(Data Science),Noida Institute of Engineering and Technology ,Greater Noida, India
Page No: 1-5-
Volume issue & Publishing Year: Volume 2 Issue 8 , June-2025
Journal: International Journal of Modern Engineering and Management | IJMEM
ISSN NO: 3048-8230
DOI:
Abstract:
In the era of digital transformation, e-commerce platforms generate massive volumes of data from user transactions, behaviors, and trends. This paper presents a scalable and interactive system using Apache Spark for big data processing, Streamlit for user interface design, and Gemini AI for AI-driven insights. The proposed solution allows users to upload e-commerce datasets, perform real-time preprocessing and visualizations, and obtain intelligent insights powered by generative AI. With support for CSV export, PDF reporting, and theme-based user experience, the system aims to bridge the gap between technical analytics and business decision-making. The paper evaluates the system's performance, usability, and scope for future enhancements.
Keywords:
Apache Spark, E-commerce Analytics, Generative AI, Streamlit Dashboard, Big Data Processing, Artificial Intelligence, Transportation, Safety.
Reference:
[1] M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, “Apache Spark: A unified engine for big data processing,” Commun. ACM, vol. 59, no. 11, pp. 56–65, Nov. 2016.
[2] A. Gandomi and M. Haider, “Beyond the hype: Big data concepts, methods, and analytics,” Int. J. Inf. Manage., vol. 35, no. 2, pp. 137–144, Apr. 2015.
[3] M. Minelli, M. Chambers, and A. Dhiraj, Big Data, Big Analytics: Emerging Business Intelligence and Analytic Trends for Today’s Businesses, 1st ed. Hoboken, NJ, USA: Wiley, 2013.
[4] M. Malik and A. Khan, “E-commerce trend prediction using machine learning techniques,” Int. J. Adv. Comput. Sci. Appl. (IJACSA), vol. 10, no. 5, pp. 292–298, 2019.
[5] Google Cloud, “Vertex AI and Gemini Integration Guide,” Google Cloud Documentation, 2023.