Elektrine lite

← Feed

@PumpkinDrama@reddthat.com

2026-03-23 23:46 UTC

How can I use a local agentic LLM on Linux to debug code similar to Anthropic use of Claude to find vulnerabilities in Firefox? cross-posted from: reddthat.com/post/62484268

Replies (1)

  • @Hexarei@beehaw.org 2026-03-24 05:25

    run a local LLM like Claude! Look inside “Run ollama” Ollama will almost always be slower than running vllm or llama.cpp, nobody should be suggesting it for anything agentic. On most consumer hardware, the availability of llama.cpp’s --cpu-moe flag alone is absurdly good and worth the effort to familiarize yourself with llamacpp instead of ollama.

    Open ##4990177