Today's AI/ML headlines are brought to you by ThreatPerspective

SambaNova makes Llama gallop in inference cloud debut

AI infra startup serves up Llama 3.1 405B at 100+ tokens per second Not to be outdone by rival AI systems upstarts, SambaNova has launched inference cloud of its own that it says is ready to serve up Meta s largest models faster than the rest.

Published: 2024-09-10T19:31:24