Leveraging Machine Learning Models for Market Trend Forecasting and Consumer Behaviour Insights
DOI:
https://doi.org/10.63503/j.ijaimd.2025.167Keywords:
Machine Learning, Consumer Clustering, Sentiment Analysis, Forecasting, Predictive Error, LSTM, ARIMAAbstract
Market trends and consumer behaviour are key aspects of data-driven industries that require an accurate forecast. This paper describes a hybrid machine learning system combining ensemble forecasting with consumer clustering and sentiment analysis to increase predictive power. With 95% accuracy, the model outperformed ARIMA (82%), LSTM (88%), and XGBoost (91%), and reduced the average predictive error to 6.5 units, vs. 12.5 used by ARIMA. The short-term processes were used to follow the demand between 120-185 and the long-term estimates provided a consistent 118-180. The use of consumer segmentation resulted in three groups (budget (2535 spending score), balanced (4055), and premium (7088)) facilitating focused strategies. On the more positive weeks, sentiment changes added 3-5% to overall forecasts representing psychological demand. The Hybrid model took 2.8 seconds per cycle compared to IQMA taking 1.2; however, its accuracy gains of between 13 and 18% prove its worth as a robust and overall system of business intelligence.
References
[1] Kumar, L., Khedlekar, S., & Khedlekar, U. K. (2024). A comparative assessment of holt winter exponential smoothing and autoregressive integrated moving average for inventory optimization in supply chains. Supply Chain Analytics, 8, 100084. https://doi.org/10.1016/j.sca.2024.100084
[2] Shandilya, S. K., Datta, A., Kartik, Y., & Nagar, A. (2024). Role of artificial intelligence and machine learning. In Digital Resilience: Navigating Disruption and Safeguarding Data Privacy (pp. 313-399). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-53290-0_6
[3] Fang, B., & Zhang, P. (2016). Big data in finance. In Big data concepts, theories, and applications (pp. 391-412). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-27763-9_11
[4] Chowdhury, A. G., Deora, R., Prathikantam, R., & Kumar, S. (2025, March). Dynamic Clustering with Deep Learning for Customer Segmentation. In 2025 7th International Conference on Intelligent Sustainable Systems (ICISS) (pp. 674-680). IEEE. https://doi.org/10.1109/ICISS63372.2025.11076506
[5] Dritsas, E., & Trigka, M. (2025). Machine Learning in e-Commerce: Trends, Applications, and Future Challenges. IEEE Access. https://doi.org/10.1109/ACCESS.2025.3572865
[6] Ankita Ghosh, Sudip Diyasi, & Siddhartha Chatterjee. (2024). Enhancing SQL Injection Prevention: Advanced Machine Learning and LSTM-Based Techniques. International Journal on Computational Modelling Applications, 1(1), 20–31. https://doi.org/10.63503/j.ijcma.2024.16
[7] Sharma, S. R., Singh, B., & Kaur, M. (2023). A novel approach of ensemble methods using the stacked generalization for high-dimensional datasets. IETE journal of research, 69(10), 6802-6817. https://doi.org/10.1080/03772063.2022.2028582
[8] Dahish, Z., Miah, S. J., Pandit, A., & Roy, S. K. (2025). Enhancing phygital customer experience through generative AI: a social listening method for strategic retail decision-making. Journal of Strategic Marketing, 1-21. https://doi.org/10.1080/0965254X.2025.2540267
[9] Kang, Y., Cai, Z., Tan, C. W., Huang, Q., & Liu, H. (2020). Natural language processing (NLP) in management research: A literature review. Journal of Management Analytics, 7(2), 139-172. https://doi.org/10.1080/23270012.2020.1756939
[10] Sykora, M., Elayan, S., Hodgkinson, I. R., Jackson, T. W., & West, A. (2022). The power of emotions: Leveraging user generated content for customer experience management. Journal of Business Research, 144, 997-1006. https://doi.org/10.1016/j.jbusres.2022.02.048
[11] Peltoniemi, M. (2015). Cultural industries: Product–market characteristics, management challenges and industry dynamics. International journal of management reviews, 17(1), 41-68. https://doi.org/10.1111/ijmr.12036
[12] Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2016). Feature selection for high-dimensional data. Progress in Artificial Intelligence, 5(2), 65-75. https://doi.org/10.1007/s13748-015-0080-y
[13] Shin, D., & Park, Y. J. (2019). Role of fairness, accountability, and transparency in algorithmic affordance. Computers in Human Behavior, 98, 277-284. https://doi.org/10.1016/j.chb.2019.04.019
[14] Barikzai, S., Bharathi S, V., & Perdana, A. (2024). Challenges and strategies in e-learning adoption in emerging economies: a scoping review. Cogent Education, 11(1), 2400415. https://doi.org/10.1080/2331186X.2024.2400415
[15] Jin, Y. C., Cao, Q., Wang, K. N., Zhou, Y., Cao, Y. P., & Wang, X. Y. (2023). Prediction of COVID-19 data using improved ARIMA-LSTM hybrid forecast models. IEEE Access, 11, 67956-67967.https://doi.org/10.1109/ACCESS.2023.3291999
[16] Liu, B., & Lai, M. (2025). Advanced machine learning for financial markets: A PCA-GRU-LSTM approach. Journal of the Knowledge Economy, 16(1), 3140-3174. https://doi.org/10.1007/s13132-024-02108-3
[17] Day, M. Y., Yang, C. Y., & Ni, Y. (2024). Portfolio dynamic trading strategies using deep reinforcement learning. Soft Computing, 28(15), 8715-8730.
https://doi.org/10.1007/s00500-023-08973-5
[18] Hwang, J., & Choi, L. (2020). Having fun while receiving rewards?: Exploration of gamification in loyalty programs for consumer loyalty. Journal of business research, 106, 365-376. https://doi.org/10.1016/j.jbusres.2019.01.031
[19] Miraftabzadeh, S. M., Colombo, C. G., Longo, M., & Foiadelli, F. (2023). K-means and alternative clustering methods in modern power systems. Ieee Access, 11, 119596-119633. https://doi.org/10.1109/ACCESS.2023.3327640
[20] Shan, S., Sun, J., & Macawile, R. M. C. (2025). Examining Customer Satisfaction Through Transformer-Based Sentiment Analysis for Improving Bilingual E-Commerce Experiences. IEEE Access. https://doi.org/10.1109/ACCESS.2025.3551666
[21] Bhati, B. S., Chugh, G., Al‐Turjman, F., & Bhati, N. S. (2021). An improved ensemble based intrusion detection technique using XGBoost. Transactions on emerging telecommunications technologies, 32(6), e4076. https://doi.org/10.1002/ett.4076
[22] Yao, J. (2024). A fusion method integrated econometrics and deep learning to improve the interpretability of prediction: evidence from Chinese carbon emissions forecast based on OLS-CNN model. Computational economics, 1-20. https://doi.org/10.1007/s10614-024-10793-0
[23] Sert, M. F. (2025). A Hybrid ARIMA-LSTM/GRU Model for Forecasting Monthly Trends in Turkey’s Gold and Currency Markets with a Macro-Economic Data-Driven Approach. In Machine Learning in Finance: Trends, Developments and Business Practices in the Financial Sector (pp. 35-51). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-83266-6_3
[24] Anuj Kumar, & Ishika Arora. (2025). Development of an Advanced Traffic Demand Prediction System Optimized Three-Phase Deep Neural Network . International Journal on Computational Modelling Applications, 2(1), 28–41. https://doi.org/10.63503/j.ijcma.2025.49