Bitcoin Return Prediction based on OLS, Random Forest, LightGBM, and LSTM

Authors

  • Gaohao Zhu

DOI:

https://doi.org/10.54691/bcpbm.v38i.3698

Keywords:

Bitcoin Prediction; Cryptocurrency; Machine Learning; LSTM; Forecasting Performance.

Abstract

Since Bitcoin was proposed in 2008, it has become a very valuable asset and an important part of many investors’ portfolios. It’s important to both understand Bitcoin mechanics and predict its valuation with the help of the state-of-art machine learning tools. The study develops four different models, including Ordinary Least Squares (OLS) regression model, Random Forest, Light Gradient Boosting Machine (LightGBM), and Long Short-Term Memory (LSTM), to predict the return of Bitcoin and compare the performance of these models. According to the analysis, the daily changes in the high, low, close price of Bitcoin, and close price of Tesla stock, and gold price between yesterday and today are all strongly correlated to the Bitcoin return on tomorrow. The statistical approach, or OLS modeling, has the simplest algorithm whereas the highest accuracy rate. The LightGBM model and LSTM model have lower accuracy rates in order, but still exceed the 50% (random benchmark). The Random Forest model, as another type of decision tree algorithm, has similar prediction results with the LightGBM model but a lower accuracy rate that fails to reach the benchmark. Based on the analysis, multiple factors affect the Bitcoin return, and these results provide an insight for investors to the cryptocurrency market and the macroeconomic environment. It validates the effectiveness of several machine learning algorithms in Bitcoin return forecasting and supports future developments in related fields.

Downloads

Download data is not yet available.

References

Satoshi Nakamoto. Bitcoin: A peer-to-peer electronic cash system. Decentralized Business Review, page 21260, 2008.

Karunya Rathan, Somarouthu Venkat Sai, and Tubati Sai Manikanta. Crypto-currency price prediction using decision tree and regression techniques. In 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI), pages 190–194, 2019.

Mohammad Ali and Swakkhar Shatabda. A data selection methodology to train linear regression model to predict bitcoin price. In 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT), pages 330–335, 2020.

Karasu S, Altan A, Saraç Z, et al. Prediction of Bitcoin prices with machine learning methods using time series data. 2018 26th signal processing and communications applications conference (SIU). IEEE, 2018: 1-4.

Nicola Uras, Lodovica Marchesi, Michele Marchesi, and Roberto Tonelli. Forecasting bitcoin closing price series using linear regression and neural networks models. PeerJ Computer Science, 6: e279, 2020.

Zheshi Chen, Chunhong Li, and Wenjun Sun. Bitcoin price prediction using machine learning: An approach to sample dimension engineering. Journal of Computational and Applied Mathematics, 365:112395, 2020.

Isaac Madan, Shaurya Saluja, and Aojia Zhao. Automated bitcoin trading via machine learning algorithms. Retrieved from: http://cs229. stanford.edu/proj2014/Isaac% 20Madan, 20, 2015.

Erdinc Akyildirim, Ahmet Goncu, and Ahmet Sensoy. Prediction of cryptocurrency returns using machine learning. Annals of Operations Research, 297(1):3–36, 2021.

Ahmed Ibrahim, Rasha Kashef, and Liam Corrigan. Predicting market movement direction for bitcoin: A comparison of time series modeling methods. Computers & Electrical Engineering, 89:106905, 2021.

Siddhi Velankar, Sakshi Valecha, and Shreya Maji. Bitcoin price prediction using machine learning. In 2018 20th International Conference on Advanced Communication Technology (ICACT), pages 144–147. IEEE, 2018.

Xiaolei Sun, Mingxi Liu, and Zeqian Sima. A novel cryptocurrency price trend fore- casting model based on lightgbm. Finance Research Letters, 32:101084, 2020.

Chih-Hung Wu, Chih-Chiang Lu, Yu-Feng Ma, and Ruei-Shan Lu. A new forecasting framework for bitcoin price with lstm. In 2018 IEEE International Conference on Data Mining Workshops (ICDMW), pages 168–175, 2018.

Ebru Seyma Karakoyun and AO Cibikdiken. Comparison of arima time series model and lstm deep learning algorithm for bitcoin price forecasting. In The 13th multidisciplinary academic conference in Prague, volume 2018, pages 171–180, 2018.

Hari Krishnan Andi. An accurate bitcoin price prediction using logistic regression with lstm machine learning model. Journal of Soft Computing Paradigm, 3(3):205– 217, 2021.

Yan Li and Wei Dai. Bitcoin price forecasting method based on cnn-lstm hybrid neural network model. The journal of engineering, 2020(13): 344–347, 2020.

Yiqing Hua. Bitcoin price prediction using arima and lstm. In E3S Web of Conferences, volume 218, page 01050. EDP Sciences, 2020.

Sean McNally, Jason Roche, and Simon Caton. Predicting the price of bitcoin using machine learning. In 2018 26th euromicro international conference on parallel, distributed and network-based processing (PDP), pages 339–343. IEEE, 2018.

Iman Abu Hashish, Fabio Forni, Gianluca Andreotti, Tullio Facchinetti, and Shiva Darjani. A hybrid model for bitcoin prices prediction using hidden markov models and optimized lstm networks. In 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pages 721–728. IEEE, 2019.

Wei Chen, Huilin Xu, Lifen Jia, and Ying Gao. Machine learning model for bitcoin exchange rate prediction using economic and technology determinants. International Journal of Forecasting, 37(1):28–43, 2021.

Takuya Shintate and Luk´aˇs Pichl. Trend prediction classification for high frequency bitcoin time series with deep learning. Journal of Risk and Financial Management, 12(1):17, 2019.

Suhwan Ji, Jongmin Kim, and Hyeonseung Im. A comparative study of bitcoin price prediction using deep learning. Mathematics, 7(10):898, 2019.

Downloads

Published

2023-03-02