Recent searches
Search options
The web can be a cool place.
Jacob from Toronto has been inspired by my grocery price data mining bullshit and started scraping Canadian stores earlier this year.
He has lots of data, and needs help. Want to do something fun, educational and possibly useful?
@badlogic This is really cool! I think some of the data analysis ideas would lead to interesting results here in AT as well.
@danimrich We did exactly that for a year :)
@badlogic Oh, sorry, I must have missed it.
@badlogic I’ve been wanting to do the same thing here in ZA. My thinking was to inspect the mobile apps from each major retailer, with the premise that there would hopefully be some sort of stability in how the product is described, or indexed. Fortunately for me, we only really have 4 major retailers covering probably 90% of the market.
How have you dealt with things like “buy one get one cheaper” type specials, etc? I guess that is more relevant to buying the cheapest basket longer term, rather than tracking price trends.
@RoganDawes I haven't dealt with that, as it's not in the data in Austria. Anecdotally, these types of discounts have become very rare here. Instead, 40% of products are now regularly discounted...
@badlogic
Has anyone done this in Australia, do you know? We have something of a duopoly, plus ALDI.
@negative12dollarbill there were 2 projects iirc, but I think they failed because scraping stopped working? Been a while.