Big data: web-crawling and analysing financial news using RapidMiner

Jesse Lane and Hak J. Kim

International Journal of Business Information Systems, 2015, vol. 19, issue 1, 41-57

Abstract: Big data today is one of the hottest topics in the ICT field, but still there are many questions around what it is, what it really means, and how it can be used. This paper presents the notion of big data and then attempts to analyse it using a typical analytics tool, which is called RapidMiner. We use actual real-world social media data as an empirical test. Our preliminary result shows that social media data does not provide valuable meaning to predict the future stock market. However, we believe that the analysis of big data is meaningful if more sophisticated methodology and data collection procedures are used.

Keywords: big data; social media; financial news; RapidMiner; web crawling; news analysis; stock markets; stock market prediction; machine learning; data mining; text mining; predictive analytics; business analytics. (search for similar items in EconPapers)
Date: 2015
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.inderscience.com/link.php?id=69064 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijbisy:v:19:y:2015:i:1:p:41-57

Access Statistics for this article

More articles in International Journal of Business Information Systems from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().