@WesternInfidels@feddit.online
2026-10-18 17:34 UTC
If you’re spending $1K per month on LLMs – putting aside whether this is productive or ethical for a moment – wouldn’t it make more sense to just pony up the $5K-$10K or so that it would cost to provision a private, local model? Might that not actually be superior in terms of corporate security?
Replies (1)
-
@frongt@lemmy.zip 2026-10-18 18:19
Definitely. We do this at my job. But a server big enough to provide a comparable service would cost at least $30k. And you likely need more than one. And you still need someone to maintain it.