News Sentiment in Bankruptcy Prediction Models: Evidence from Russian Retail Companies

Cover Page

Cite item

Full Text

Abstract

This study is aimed at investigating the application of news sentiment analysis to bankruptcy prediction models in the context of the Russian retail sector.

We analyse 190 companies: 95 Russian retail companies that went bankrupt in 2015-2019, and 95 non-defaulting analogue companies. This figure was attained from a larger pool of 312 companies retrieved from the Spark database on the basis of analysis of relevant financial data and further validated by the presence of pertinent news media coverage within 3 years of default date. The methodological base of this analysis is the logistic regression approach, used as a benchmark model, and several machine learning models: random forest, support vector machine, and multilayer perceptron.

The predictor set applied consists of 34 financial variables and sentiment variables, aggregated using the ‘bag-of-words’ from a total sample of 4877 news articles, from more than 800 distinct online resource locations. We establish a set of hypotheses based on a review of existing literature in the area, and evaluate their accuracy on the basis of our technical analysis.

Our results show that sentiment variables are statistically significant, and that adding sentiment variables improves the performance of bankruptcy prediction models. Also, the results indicate some reference characteristics of companies in terms of word-choice and descriptions in the news, indicating word choices correlated with financially stability and those correlated with financially instability.

About the authors

E. Makeeva

Author for correspondence.
Email: len-makeeva@yandex.ru

M. Sinilshchikova

Email: mariasinilshchikova@gmail.com

References

  1. Wang G., Chen G., Chu Y. A new random subspace method incorporating sentiment and textual information for financial distress prediction. Electronic Commerce Research and Applications. 2018 May 1;29:30-49.
  2. Gupta K., Banerjee R. Does OPEC news sentiment influence stock returns of energy firms in the United States? Energy Economics. 2019 Jan 1;77:34-45.
  3. Kearney C., Liu S. Textual sentiment in finance: A survey of methods and models. International Review of Financial Analysis. 2014 May 1;33:171-85.
  4. Zhang Y., Jin R., Zhou Z.H. Understanding bag-of-words model: a statistical framework. International Journal of Machine Learning and Cybernetics. 2010 Dec 1;1(1-4):43-52.
  5. Koltsova O.Y., Alexeeva S., Kolcov S. An opinion word lexicon and a training dataset for Russian sentiment analysis of social media. Computational Linguistics and Intellectual Technologies: Materials of DIALOGUE. 2016;2016:277-87.
  6. Aziz M.A., Dar H.A. Predicting corporate bankruptcy: where we stand? Corporate Governance: The International Journal of Business in Society. 2006.
  7. Alaka H.A., Oyedele L.O., Owolabi H.A., Kumar V., Ajayi S.O., Akinade O.O., Bilal M. Systematic review of bankruptcy prediction models: Towards a framework for tool selection. Expert Systems with Applications. 2018 Mar 15;94:164-84.
  8. Shi Y., Li X. An overview of bankruptcy prediction models for corporate firms: A systematic literature review. Intangible Capital. 2019;15(2):114-27.
  9. Kumar P.R., Ravi V. Bankruptcy prediction in banks and firms via statistical and intelligent techniques—A review. European Journal of Operational Research. 2007 Jul 1;180(1):1-28.
  10. Tsai C.F., Hsu Y.F., Yen D.C. A comparative study of classifier ensembles for bankruptcy prediction. Applied Soft Computing. 2014 Nov 1;24:977-84.
  11. Ciampi F., Gordini N. Managerial characteristics and default prediction modeling for small firms: Evidence from small Italian firms. In: 35 Convegno Annuale AIDEA—Management Senza Confini. Gli Studi di Management Tradizione e Paradigmi Emergenti. 2012. p. 1-19.
  12. Chen N., Ribeiro B., Chen A. Financial credit risk assessment: a recent review. Artificial Intelligence Review. 2016 Jan 1;45(1):1-23.
  13. Ding Y., Song X., Zen Y. Forecasting financial condition of Chinese listed companies based on support vector machine. Expert Systems with Applications. 2008 May 1;34(4):3081-9.
  14. Chandra D.K., Ravi V., Bose I. Failure prediction of dotcom companies using hybrid intelligent techniques. Expert Systems with Applications. 2009 Apr 1;36(3):4830-7.
  15. Kohut G.F., Segars A.H. The president's letter to stockholders: An examination of corporate communication strategy. The Journal of Business Communication. 1992 Jan;29(1):7-21.
  16. Park S., Lee J., Kim K. Semi-supervised distributed representations of documents for sentiment analysis. Neural Networks. 2019 Nov 1;119:139-50.
  17. Callison C., Zillmann D. Company affiliation and communicative ability: How perceived organizational ties influence source persuasiveness in a company-negative news environment. Journal of Public Relations Research. 2002 Mar 1;14(2):85-102.
  18. Broadstock D.C., Zhang D. Social-media and intraday stock returns: The pricing power of sentiment. Finance Research Letters. 2019 Sep 1;30:116-23.
  19. Kothari S.P., Li X., Short J.E. The effect of disclosures by management, analysts, and business press on cost of capital, return volatility, and analyst forecasts: A study using content analysis. The Accounting Review. 2009 Sep;84(5):1639-70.
  20. Loughran T., McDonald B. Measuring readability in financial disclosures. The Journal of Finance. 2014 Aug;69(4):1643-71.
  21. Loughran T., McDonald B. When is a liability not a liability. Journal of Finance, forthcoming. 2009 May 6.
  22. Azam N., Yao J. Comparison of term frequency and document frequency based feature selection metrics in text categorization. Expert Systems with Applications. 2012 Apr 1;39(5):4760-8.
  23. Chen et al. Turning from TF-IDF to TF-IGM for term weighting in text classification. Expert Systems with Applications. 2016;66:245-260.
  24. Mai F., Tian S., Lee C., Ma L. Deep learning models for bankruptcy prediction using textual disclosures. European Journal of Operational Research. 2019 Apr 16;274(2):743-58.
  25. Hájek P., Olej V., Myskova R. Forecasting corporate financial performance using sentiment in annual reports for stakeholders' decision-making. Technological and Economic Development of Economy. 2014 Oct 2;20(4):721-38.
  26. Caporale G.M., Spagnolo F., Spagnolo N. Macro news and stock returns in the Euro area: a VAR-GARCH-in-mean analysis. International Review of Financial Analysis. 2016 May 1;45:180-8.
  27. Dzielinski M. News sensitivity and the cross-section of stock returns. NCCR FINRISK. 2011;(719).
  28. Leung D.K., Lee F.L. How journalists value positive news: The influence of professional beliefs, market considerations, and political attitudes. Journalism Studies. 2015 Mar 4;16(2):289-304.
  29. Apergis N., Miller S.M. Consumption asymmetry and the stock market: empirical evidence. Economics Letters. 2006 Dec 1;93(3):337-42.
  30. Olson D.L., Delen D., Meng Y. Comparative analysis of data mining methods for bankruptcy prediction. Decision Support Systems. 2012 Jan 1;52(2):464-73.
  31. Gardner J., Brooks C. Statistical approaches to the model comparison task in learning analytics.
  32. Lu Y.C., Shen C.H., Wei Y.C. Revisiting early warning signals of corporate credit default using linguistic analysis. Pacific-Basin Finance Journal. 2013 Sep 1;24:1-21.
  33. Papakyriakou P., Sakkas A., Taoushianis Z. Financial firm bankruptcies, international stock markets, and investor sentiment. International Journal of Finance & Economics. 2019 Jan;24(1):461-73.
  34. Bird S., Klein E., Loper E. Natural language processing with Python: analyzing text with the natural language toolkit. O'Reilly Media, Inc.; 2009 Jun 12.
  35. Korobov M. Morphological analyzer and generator for Russian and Ukrainian languages. In: International Conference on Analysis of Images, Social Networks and Texts. 2015 Apr 9. p. 320-32. Springer, Cham.
  36. Geng R., Bose I., Chen X. Prediction of financial distress: An empirical study of listed Chinese companies using data mining. European Journal of Operational Research. 2015 Feb 16;241(1):236-47.
  37. Kirasich K., Smith T., Sadler B. Random forest vs logistic regression: Binary classification for heterogeneous datasets. SMU Data Science Review. 2018;1(3):9.
  38. Salazar D.A., Vélez J.I., Salazar J.C. Comparison between SVM and logistic regression: Which one is better to discriminate? Revista Colombiana de Estadística. 2012 Jun;35(SPE2):223-37.
  39. Gaudart J., Giusiano B., Huiart L. Comparison of the performance of multi-layer perceptron and linear regression for epidemiological data. Computational Statistics & Data Analysis. 2004 Jan 28;44(4):547-70.
  40. Engelberg J. Costly information processing: Evidence from earnings announcements. In: AFA 2009 San Francisco meetings paper. 2008.
  41. Ahmadi Z., Martens P., Koch C., Gottron T., Kramer S. Towards bankruptcy prediction: deep sentiment mining to detect financial distress from business management reports. In: 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA). 2018 Oct 1. p. 293-302. IEEE.
  42. Beaver W.H. Financial ratios as predictors of failure. Journal of Accounting Research. 1966 Jan 1:71-111.
  43. Fulmer J.G., Moon J., Gavin T.A., Erwin M. A bankruptcy classification model for small firms. Journal of Commercial Bank Lending. 1984 Jul;66(11):25-37.
  44. Fedorova E., Demin I., Khrustova L., Osetrov R., Fedorov F. The influence of the tone of the CEO's letters on the company's financial performance. Russian Journal of Management. 2017;15(4).
  45. Ohlson J.A. Financial ratios and the probabilistic prediction of bankruptcy. Journal of Accounting Research. 1980 Apr 1:109-31.
  46. Qu Y., Quan P., Lei M., Shi Y. Review of bankruptcy prediction using machine learning and deep learning techniques. Procedia Computer Science. 2019 Jan 1;162:895-9.
  47. Bellovary J.L., Giacomino D.E., Akers M.D. A review of bankruptcy prediction studies: 1930 to present. Journal of Financial Education. 2007 Dec 1:1-42.
  48. West R.C. A factor-analytic approach to bank condition. Journal of Banking & Finance. 1985 Jun 1;9(2):253-66.
  49. Merton R.C. On the pricing of corporate debt: The risk structure of interest rates. The Journal of Finance. 1974 May 1;29(2):449-70.
  50. Feller W. An introduction to probability theory and its applications, vol 2. John Wiley & Sons; 2008.
  51. Nilsson P. The influence of related and unrelated industry diversity on retail firm failure. Journal of Retailing and Consumer Services. 2016 Jan 1;28:219-27.
  52. Gleason K.C., Mathur L.K., Mathur I. The interrelationship between culture, capital structure, and performance: evidence from European retailers. Journal of Business Research. 2000 Nov 1;50(2):185-91.
  53. Ahmad Z., Abdullah N.M., Roslan S. Capital structure effect on firms performance: Focusing on consumers and industrials sectors on Malaysian firms. International Review of Business Research Papers. 2012 Jul;8(5):137-55.
  54. Gaur V., Fisher M.L., Raman A. An econometric analysis of inventory turnover performance in retail services. Management Science. 2005 Feb;51(2):181-94.
  55. Akinboade O.A., Mokwena M.P., Kinfack E.C. Estimating profit efficiency among South African retail firms using stochastic frontier approach. The International Review of Retail, Distribution and Consumer Research. 2008 Dec 1;18(5):511-20.
  56. Makeeva E., Bakurova A. Forecasting bankruptcy oil and gas companies using neural networks. Journal of Corporate Finance Research. 2012;(3(23)):22-30.
  57. Демешев Б.Б., Тихонова А.С. Динамика прогнозной силы моделей банкротства для средних и малых российских компаний оптовой и розничной торговли. Корпоративные финансы. 2014;8(3).
  58. Mselmi N., Lahiani A., Hamza T. Financial distress prediction: The case of French small and medium-sized firms. International Review of Financial Analysis. 2017 Mar 1;50:67-80.
  59. Altman E.I. Financial ratios, discriminant analysis and the prediction of corporate bankruptcy. The Journal of Finance. 1968 Sep 1;23(4):589-609.
  60. Altman E.I., Sabato G. Modeling credit risk for SMEs: Evidence from the US market. In: Managing and Measuring Risk: Emerging Global Standards and Regulations After the Financial Crisis. 2013. p. 251-79.
  61. Pradhan R., Pathak K.K., Singh V.P. A study of credit lending and prediction of bankruptcy using back-propagation neural networks. IIMS Journal of Management Science. 2012;3(2):179-93.
  62. Zhang W. R&D investment and distress risk. Journal of Empirical Finance. 2015 Jun 1;32:94-114.

Supplementary files

Supplementary Files
Action
1. JATS XML
Download

Copyright (c) 2020 Makeeva E., Sinilshchikova M.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.