Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K context

Y	Hacker News new \| ask \| show \| jobs

	Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K context (lucebox.com)
	20 points by GreenGames 21 days ago

1 comments

Any 3090? Or does the Ryzen AI MAX+ 395 and 128GB LPDDR5X unified memory on the Lucebox matter?

Anyone compare with the club-3090 dual setup?