http://needgap.com Find your customers by the problem you are solving for them. Wed, 17 May 2023 23:59:00 +0000 <div>With all the WallStreetBets hype I've been developing/testing automated investment/trading strategies in crypto/stocks. I was struggling to get large amounts of data cheaply like total historical stock/crypto prices or historical news, eCommerce pricing and stock levels. To resolve this I had to rely on heavy scraping or work with a variety of vendors who specialise in different datasets which increases infrastructure cost, risks getting IP blocked, increases load on the target server and increases data sourcing cost. I spent more time managing scrapers, bots and data streams instead of working on the analysis, research and building my app</div> 3 points posted by gigadata /problems/342-historical-datasets-are-expensive-hard-to-find-finance-datascience 342 Mon, 13 Dec 2021 06:45:00 +0000 I see that several politicians, govt. officials mention that new cases of COVID-19 would come down as the global temperature rises owing to seasonal changes. Yet, daily reported cases around the world is <a href="https://ourworldindata.org/coronavirus#what-we-would-want-to-know">growing exponentially</a> even as the temperature rises.<div><br></div><div>I would like to know the temperature and other weather correlation with the new confirmed cases of COVID-19, I don't think there is yet a visualisation available for that.</div> 3 points posted by Asra Banu /problems/97-weather-correlation-with-covid-19-datascience-coronavirus 97 Mon, 09 Mar 2020 13:14:00 +0000 Often I'm in a position where I would like to get quick insights on a web data or pdf but not equipped to run a proper data science setup or isn't economical to task it to a data scientist.<div><br></div><div>A web scrapper with builtin insight generator would solve this problem.</div><div><br></div><div>Say, I spin up the scrapper in the web page, select necessary data to be scrapped, mark relationships between them and at the end of the scrapping I get neat visualisations for the insights regarding the data. It can be more useful, if input is not limited to the web pages but also pdf, spreadsheet, csv etc.</div><div><br></div><div>I think there is a need gap to bridge modern data science advancements to non-coders who deal with large data.</div> 3 points posted by Bakshara /problems/86-on-demand-data-science-without-coding-datascience-nocode 86 Wed, 12 Feb 2020 13:08:00 +0000