Hacker News new | ask | show | jobs
by neurodyne 148 days ago
Not to be yet another critical voice, but where are your prices actually coming from? I'm in the US, and I just chose the top three "Price/TB" items and none of the prices on your site agree with the actual item pages on Amazon.

  - Toshiba X300 16TB Performance & Gaming 3.5-Inch Internal Hard Drive
  - https://terabytedeals.com/us: $229.95
  - https://amazon.com/dp/B0CYQXNCVZ: $353.30 new

  - Western Digital 18TB WD Red Pro NAS Internal Hard Drive HDD
  - https://terabytedeals.com/us: $259.99
  - https://amazon.com/dp/B08K3TFM92: $361.53 used, $549.59 new

  - Western Digital 22TB WD Purple Pro Surveillance Internal Hard Drive HDD
  - https://terabytedeals.com/us: $329.69
  - https://amazon.com/dp/B0B5VYRJ6Q: $465.00 new
You can claim Amazon price volatility, but I don't suspect that to be what's going on here. CamelCamelCamel price history graphs show that these items have never been anywhere near the terabytedeals.com prices looking back the last three months, including Amazon, 3rd Party New, or 3rd Party Used prices.

  - https://3cmls.co/US/B0CYQXNCVZ
  - https://3cmls.co/US/B08K3TFM92
  - https://3cmls.co/US/B0B5VYRJ6Q
In fact, my spidey senses are tingling. The only strings that match the terabytedeals.com prices are completely different items.

These other items and prices only appear if you choose the "See All Buying Options" button or the "Other sellers on Amazon" menu. Then wait for the "Didn't find what you were looking for? Consider these alternative items" section to load.

  - For B0CYQXNCVZ (16TB), Amazon offers https://www.amazon.com/dp/B07NTDWMSQ (6TB) which *IS* listed as $229.95.
  - For B08K3TFM92 (18TB), Amazon offers https://www.amazon.com/dp/B0CMJPRLJV (18TB) which *IS* listed as $259.99.
  - For B0B5VYRJ6Q (22TB), Amazon offers https://www.amazon.com/dp/B0966V6YJB (12TB) which *IS* listed as $329.69.
That this pattern holds true for three items, seems like maybe the wrong prices are being scraped somehow?
1 comments

You are onto something, I am using a mix of scraping and APIs, and the scraped products don't seem to be accurate due to a faulty CSS selector.

I am running the process once again to get some - hopefully - better data!

Was about to say, but it looks like you’re working on it!

Cool idea, it’s already been helpful to me even with the often inaccurate scraping.

Great! Looking forward to giving it another go once the data has refreshed.

Congrats on the launch!

US data should now be refreshed. Prices look much better, but I am still working on product availability. In some cases the API is returning a price and the only way around that is scraping