Hacker News new | ask | show | jobs
by rgbrgb 828 days ago
This is so cool, congrats on the launch!

I have a friend who looked into doing something similar but they couldn't figure out a way to get the cost low enough. This was like a year ago so I'd guess it's much cheaper now and you could do something like fine-tuning a smaller domain specific model on GPT-4 outputs.

Any ballparks on pricing / cost? What models are ya'll using?

1 comments

Thanks! That's fascinating, do you remember what kind of tasks they served?

Using GPT-4 and GPT-3.5 currently, and costs can be $1.50+ per request right now (have been benefiting from YC cloud credits!). Definitely steep at the moment but we expect costs to come down at least 10x over time.

Not super clear on pricing yet (only a few weeks post-launch)

I think it was similar... an agent finds a bunch of info on a private/public company to evaluate investment (automating some associate analyst work). TBH I'm not sure where they ended up but I know they had an interesting distribution channel lined up. Happy to connect if you want.

> $1.50

Thanks for sharing! I think they were ~10x that but hadn't done a ton of optimization yet. To me, having a swag at cost makes these tool demos a lot more interesting because you can start figuring out what types of businesses you can/can't build with them.

would love the connect to learn more about what they tried, I'm at wilbur at meticulate.ai

Definitely... we're lucky to be in an industry where there's a lot of money at stake