▲ ▼ Historical datasets are expensive, hard to find
With all the WallStreetBets hype I've been developing/testing automated investment/trading strategies in crypto/stocks. I was struggling to get large amounts of data cheaply like total historical stock/crypto prices or historical news, eCommerce pricing and stock levels. To resolve this I had to rely on heavy scraping or work with a variety of vendors who specialise in different datasets which increases infrastructure cost, risks getting IP blocked, increases load on the target server and increases data sourcing cost. I spent more time managing scrapers, bots and data streams instead of working on the analysis, research and building my app
i had a similar need and was able to solve it with https://webz.io for the data feeds.
they also have good support if you need something further
May I ask what was the need and how did you solve it using webz.io?
As explained in the post I was struggling to access large valuable datasets like total historical stock/crypto prices or historical news to analyse patterns and so I built a tool that does this.
Basically you can get data like stock & crypto prices, news, financials, press releases, shareholder changes, reddit posts via an API in JSON or CSV format. I am adding more exchanges and alternative datasets like eCommerce pricing and stock levels with time. The data goes back decades, It's cleaned, formatted and analysis ready.
It resolves a few issues:
- Transparent pricing with no limit to API calls
- Access to many datasets not limited to one particular region or category
- No more scraping, Just access the data you want via an API
- No more managing sorting, wrangling, scraping, indexing infrastructure so you can just focus on building your App, doing your research, analysis or getting an edge in the market
The project is still in development and looking to launch an Alpha soon. Would love to get any feedback, questions or to simply find out your data needs
Here is a link: https://gigadata.com.au/