Incorporating Sentiment and Temporal Information for Bitcoin Price Prediction
DOI:
https://doi.org/10.54691/bcpbm.v34i.3097Keywords:
Bitcoin, Finance, Sentiment analysis, Transformer, LSTM.Abstract
Recent years have witnessed the rapid development of bitcoin as the first digital currency. Considering the advantages of bitcoin for both individuals and society, the price prediction of bitcoin is a hot topic. However, there remain two main challenges to be addressed in this task. Firstly, because bitcoin is vulnerable to the attitudes of the investors, incorporating the sentiment semantics from the social media into the prediction is challenging. Secondly, it is intractable to predict extreme volatility of the bitcoin price. To tackle the above challenges, this paper proposes to incorporate sentiment and temporal information simultaneously. For the first challenge, this paper employs external unsupervised corpus to conduct the domain-specific post-pretraining on the off-the-shelf language model. And the sentiment analysis on the tweets is done to obtain the scores. For the second one, Long Short Term Memory (LSTM) network is leveraged to joint model the temporal price data and the sentiment scores, thus deriving the final predictions. Experiments on the real data show that compared with the single-layer LSTM model, the model in this paper works better, which provides help for investors to specify trading strategies and also provides implications for government agencies that are developing digital currencies.
Downloads
References
Velde, F., Bitcoin: A primer. 2013.
Böhme, R., et al., Bitcoin: Economics, technology, and governance. Journal of economic Perspectives, 2015. 29(2): p. 213-38.
Balcilar, M., et al., Can volume predict Bitcoin returns and volatility? A quantiles-based approach. Economic Modelling, 2017. 64: p. 74-81.
Shah, D. and K. Zhang. Bayesian regression and Bitcoin. in 2014 52nd annual Allerton conference on communication, control, and computing (Allerton). 2014. IEEE.
Georgoula, I., et al., Using time-series and sentiment analysis to detect the determinants of bitcoin prices. Available at SSRN 2607167, 2015.
Kristoufek, L., BitCoin meets Google Trends and Wikipedia: Quantifying the relationship between phenomena of the Internet era. Scientific reports, 2013. 3(1): p. 1-7.
Polasik, M., et al., Price fluctuations and the use of bitcoin: An empirical inquiry. International Journal of Electronic Commerce, 2015. 20(1): p. 9-49.
McNally, S., J. Roche, and S. Caton. Predicting the price of bitcoin using machine learning. in 2018 26th euromicro international conference on parallel, distributed and network-based processing (PDP). 2018. IEEE.
Stenqvist, E. and J. Lönnö, Predicting Bitcoin price fluctuation with Twitter sentiment analysis. 2017.
Barbieri, F., et al., Tweeteval: Unified benchmark and comparative evaluation for tweet classification. arXiv preprint arXiv:2010.12421, 2020.
Loureiro, D., et al., Timelms: Diachronic language models from twitter. arXiv preprint arXiv:2202.03829, 2022.
Xu, F., et al., MoCA: Incorporating Multi-stage Domain Pretraining and Cross-guided Multimodal Attention for Textbook Question Answering. arXiv preprint arXiv:2112.02839, 2021.
Muzammal, M., Q. Qu, and B. Nasrulin, Renovating blockchain with distributed databases: An open source system. Future generation computer systems, 2019. 90: p. 105-117.
Katsiampa, P., Volatility estimation for Bitcoin: A comparison of GARCH models. Economics letters, 2017. 158: p. 3-6.
Ozturk, S.S., Dynamic connectedness between bitcoin, gold, and crude oil volatilities and returns. Journal of Risk and Financial Management, 2020. 13(11): p. 275.
Duan, J., et al., A content-analysis based literature review in blockchain adoption within food supply chain. International journal of environmental research and public health, 2020. 17(5): p. 1784.
Guesmi, K., et al., Portfolio diversification with virtual currency: Evidence from bitcoin. International Review of Financial Analysis, 2019. 63: p. 431-437.
Wu, K., et al., A Coefficient of Variation Method to Measure the Extents of Decentralization for Bitcoin and Ethereum Networks. Int. J. Netw. Secur., 2020. 22(2): p. 191-200.
Ramadhani, A.M., et al., Bitcoin Price Forecasting Using Neural Decomposition and Deep Learning. Journal of the Korea Industrial Information Systems Research, 2018. 23(4): p. 81-92.
Vaswani, A., et al., Attention is all you need. Advances in neural information processing systems, 2017. 30.
Xu, F., et al. Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning. in Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022.
Yun, S., et al., Graph transformer networks. Advances in neural information processing systems, 2019. 32.
Hochreiter, S. and J. Schmidhuber, Long short-term memory. Neural computation, 1997. 9(8): p. 1735-1780.






