Multi-day Window for Stock Movement Prediction and Financial News Classification for Predicting Market Sentiments
##plugins.themes.academic_pro.article.main##
Abstract
There are many factors that influence the stock market prices and the general sentiment of the market. It has been difficult for a very long time to predict the stock prices in an accurate way using an automated system because stock prices are extremely volatile in nature as they depend on a variety of factors like financial/political news, historical prices, and market sentiments. In this paper, the proposed individual models take into consideration the above-mentioned factors to predict the future stock price movement and market sentiment. This is done by gathering all credible financial news data and historical stock price data. The proposed News Sentiment model uses deep learning to predict the next day's market sentiment i.e. bullish/bearish. This four-class news sentiment detection Four Class - News Sentiment Detection (FC-NSD) model has a testing accuracy of ~43\% and a R2 score of ~0.25 which is higher than previously published models. The proposed classification model (CDWM - Convolutional Dual Window Model) leverages one-dimensional convolutional layers to remove noise and learn patterns. This coupled with a unique pipeline that uses multi-day window prices for training is implemented to predict the future stock movement with higher accuracy. The proposed LSTM classification model achieves a state-of-the-art classification accuracy of 68.75\% in the binary buy-sell classification problem which is ~8\% more than the existing state of the art models.
##plugins.themes.academic_pro.article.details##
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
- Abirami, A. M. and Gayathri, V. 2017. A survey on sentiment analysis methods and approach. 2016 Eighth International Conference on Advanced Computing (ICoAC), 72–76.
- Alsaeedi, A. and Khan, M. 2019. A study on sentiment analysis techniques of twitter data.International Journal of Advanced Computer Science and Applications Vol.10, pp.361–37
- Brown, R. G. 2004. Smoothing, forecasting and prediction of discrete time series.
- Ding, G. and Qin, L. 2020. Study on the prediction of stock price based on the associated network model of lstm. International Journal of Machine Learning and Cybernetics Vol.11.
- Hochreiter, S. and Schmidhuber, J. 1997. Long short-term memory. Neural Computation Vol.9, pp.1735–1780.
- Hu, Z., Liu, W., Bian, J., Liu, X., and Liu, T.-Y. 2018. Listening to chaotic whispers:A deep learning framework for news-oriented stock trend prediction. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining.
- Ide, H. and Kurita, T. 2017. Improvement of learning for cnn with relu activation by sparse regularization. 2017 International Joint Conference on Neural Networks (IJCNN), pp.2684–2691.
- Joshi, K., N, B., and Rao, J. 2016. Stock trend prediction using news sentiment analysis. International Journal of Computer Science and Information Technology Vol.8, pp.67–76.
- Mikolov, T., Chen, K., Corrado, G., and Dean, J. 2013. Efficient estimation of word representations in vector space.
- Naren.J. 2017. News analytics and dual sentiment analysis for stock market prediction.
- Nguyen, T. and Shirai, K. 2015. Topic modeling based sentiment analysis on social media for stock market prediction. Vol. Vol.1.
- Nikou, M., Mansourfar, G., and Bagherzadeh, J. 2019. Stock price prediction using deep learning algorithm and its comparison with machine learning algorithms. Intelligent Systems in Accounting, Finance and Management Vol.26.
- O’Shea, K. and Nash, R. 2015. An introduction to convolutional neural networks.ArXiv abs/1511.08458.
- Pagolu, V. S., Challa, K., Panda, G., and Majhi, B. 2016. Sentiment analysis of twitter data for predicting stock market movements. 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES), pp.1345–1350.
- Porshnev, A., Redkin, I., and Shevchenko, A. 2013. Machine learning in prediction of stock market indicators based on historical data and data from twitter sentiment analysis.2013 IEEE 13th International Conference on Data Mining Workshops, pp.440–444.
- Sawhney, R., Agarwal, S., Wadhwa, A., and Shah, R. R. 2020. Deep attentive learning for stock movement prediction from social media text and company correlations. In Proceedingsof the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP).Association for Computational Linguistics, pp.8415–8426.
- Selvin, S., Vinayakumar, R., Gopalakrishnan, E. A., Menon, V. K., and Soman, K. P.2017. Stock price prediction using lstm, rnn and cnn-sliding window model. 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI),pp.1643–1647.
- Taj, S., Shaikh, B. B., and Fatemah Meghji, A. 2019. Sentiment analysis of news articles: A lexicon based approach. In 2019 2nd International Conference on Computing, Mathematics and Engineering Technologies (iCoMET). pp.1–5.
- Xu, F. and Keselj, V. 2014. Collective sentiment mining of microblogs in 24-hour stock price movement prediction. 2014 IEEE 16th Conference on Business Informatics Vol.2,pp.60–67.
- Xu, Yumo andCohen, S. B. 2018. Stock movement prediction from tweets and historical prices.In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(Volume 1: Long Papers). Association for Computational Linguistics, pp.1970–1979.
- Zhang, X., Qu, S., Huang, J., Fang, B., and Yu, P. 2018. Stock market prediction via multi-source multiple instance learning. IEEE Access Vol.PP, pp.1–1.