Hacker News new | ask | show | jobs
by blastro 380 days ago
This hasn't been my experience. Pretty easy with AWS Bedrock
1 comments
paxys 380 days ago
Ah yes, "self host" by using a fully Amazon-managed service on Amazon's servers. How would a US court ever access those logs?
link
garyfirestorm 379 days ago
Run a vllm docker container. Yeah the assumption is you already know what hardware you need or you already have it on prem. Assuming this is ITAR stuff, you must be self hosting everything.
link