Nodegrove VRAM: can I run it?
Can this LLM run on my GPU? VRAM, speed ceiling and what fits instead, for any model and GPU.
Connect it
Settings → Connectors → Add custom connector
URL: https://mcp.nodegrove.io/mcpSettings → Apps & Connectors → Advanced → Developer mode
Create connector with URL: https://mcp.nodegrove.io/mcp{
"mcpServers": {
"vram-mcp": {
"url": "https://mcp.nodegrove.io/mcp"
}
}
}claude mcp add --transport http vram-mcp https://mcp.nodegrove.io/mcp{
"servers": {
"vram-mcp": {
"type": "http",
"url": "https://mcp.nodegrove.io/mcp"
}
}
}{
"mcpServers": {
"vram-mcp": {
"command": "npx",
"args": [
"-y",
"@nodegrove/vram-mcp@1.1.3"
]
}
}
}claude mcp add vram-mcp -- npx -y @nodegrove/vram-mcp@1.1.36 tools, verified live
can_i_runread-onlyCan this GPU run this open-weight LLM? Returns fits, tight or no, the memory split (weights, KV cache, overhead), a decode-speed ceiling, the longest context that fits and, on a no, every change that would make it fit: quantisation, KV cache, context, another card or a smaller model. Model: a name or id from list_models, any Hugging Face repo id, or its architecture. GPU: a name or id from list_gp
what_fitsread-onlyWhich open-weight LLMs fit this GPU: every model in list_models checked at one quantisation and context, with a recommended everyday model (the biggest class that fits with room for context at conversational speed), the largest that fits, the best at Q8 and the first out of reach. GPU: a name or id from list_gpus, or vram_gb for any other card.
estimate_vramread-onlyHow much memory an LLM needs: weights + KV cache + overhead at each quantisation (or one), at a given context, and the smallest common card class that holds each. Model: a name or id from list_models, any Hugging Face repo id, or its architecture (params_b, layers, kv_heads, head_dim).
estimate_from_hf_reporead-onlyReads any Hugging Face model repo's config.json and parameter count and estimates its memory: the attention layout found (standard, sliding-window, hybrid or latent), how much each 1,000 tokens of context costs, and weights + KV cache + overhead at every quantisation. For models nodegrove.io has not reviewed; anything the reader cannot model is listed in warnings.
list_modelsread-onlyThe open-weight LLMs nodegrove.io has verified against their config.json (data version 2026-10-16): id, size, attention design, native context, licence, memory at Q4 with 8k context and each model's page.
list_gpusread-onlyThe GPUs and machines nodegrove.io covers: memory, the memory a runtime can use and bandwidth, from the makers' specs, with each one's page.
Change history
Alternatives in AI & Agents
Compare →DDDdA
Czech & EU due diligence in one call — facts, insolvency, sanctions, VAT, risk score, UBO chain.
SUSuperlogA
Open-source agent that observes and fixes your application. Query logs, traces, metrics, incidents.
RERealestateA
Czech distressed real estate — anonymized district aggregates (k≥5). Free tier.
SASanctionsA
Sanctions screening for KYC/AML — EU FSF + OFAC SDN checks for Czech companies & individuals.
ARAresA
Czech & Slovak business registry — company lookup by IČO, name, legal form, VAT. Official ARES.
SISignal8A
SEC filings, dilution, insider & institutional ownership, and political-trade data for AI agents.