Hacker News new | ask | show | jobs
by mszcz 1415 days ago
> Like for example the CME deal, to open source live, low latency stock market data. Bloomberg might let you rent it for 25k a year if you're lucky. Google? Yeah just hook into the websocket bro, it's free.

Cursory search turned up nothing for me. Can you point me in the direction where I can find free (or low cost) market data that you mentioned?
1 comments
redanddead 1415 days ago
https://cloud.google.com/blog/topics/financial-services/buil...

This link has more info

link
geph2021 1415 days ago
That seems really cool, thanks for posting. However, I did notice that their demo does not seem to have any live prices right now (the demo is a couple years old, so maybe no longer live): https://showcase.withgoogle.com/marketdata

Also, to the point about Bloomberg's high subscription fees, they provide all imaginable financial data under the sun. This google demo with CME is just CME data, which is a small, albeit important, part of market data, let alone the broader financial data. Furthermore, in many cases the data itself is owned by the exchanges, so Bloomberg's fees reflect passing on the (at times exorbitant) exchange fees. NYSE, NASDAQ, CME, etc.. are historically the ones that are the gatekeepers of the data and putting up financial barriers.

link
nly 1415 days ago
Pretty sure a Bloomberg terminal subscription doesn't get you unlimited data at all the venues. You still have to pay extra to subscribe to individual feeds.

And yes, you're right on these costs. Some exchanges will charge large 5 figure sums annually just to give you a port so you can subscribe to some unreliable (UDP), poorly thought out, over-engineered-in-the-early-2000s, market data protocol that requires you to spend weeks of engineering effort to debug and normalize because hey... every exchange wants to use a different tech stack and none of their customers want to use a vendor library, so they don't exist.

The irony is a lot of organisations that are used to dealing with these feeds struggle when it comes to crypto, because they're not used to a world of websockets and public facing IPs, or the risk of exposing their machines to the internet.

One company I know pays a small 5 figure annual sum to a shitty "cloud solutions provider" for what is essentially just a dual NIC reverse proxy providing access to Coinbase via a stable IP. The is provider of course charges thousands per IP. Managing public cloud infrastructure is just outside of its comfort zone.

link
redanddead 1415 days ago
Yeah the bloomberg terminal is still good value if you're going to be using that data, and a relatively good price. Good point about the exchanges
link
gregsadetsky 1415 days ago
I see that CME is using GCP to offer its data stream, but it doesn't seem free.

"This innovative collaboration with Google Cloud will not only make it easier for our clients to access the data [...] CME Group customers will be able to access all real-time CME Group data [...]" (emphasis mine) [0]

As for [1], it has a Contact Us form and a link to [2] which talks about onboarding and an "On-demand, pay as you go model".

Could you point to the free market data pub/sub and/or specific steps to recreate the demo? Thanks!

[0] https://www.prnewswire.com/news-releases/cme-group-to-offer-...

[1] https://www.cmegroup.com/market-data/connect-data/cloud-mdp....

[2] https://dataservices.cmegroup.com/Data-Products

link