As investors look for new ways to beat the market, total spending on web scraping for investment purposes is expected to exceed $1.8 billion by 2020.