FLE Link

FLE Link / Your card

What runs on a 12 GB GPU: local AI models that fit

A 12 GB NVIDIA card runs more than its memory suggests. For mixture-of-experts models the FLE engine keeps the experts in RAM and only the busiest ones on the GPU, so the RAM decides which model fits. With 128 GB of RAM the biggest model in the catalog that fits a 12 GB card is Kate 27B + DSpine.

12 GB card with 32 GB of RAM

ModelDoes it fit?Measured on this hardwareOne command
Llama 3.2 1B1B, a first try on any laptopfitsnot measured on this sizeflelink run llama-3.2-1b
Katy 27B + DFlash2dense 27B with a draft modelfits11.2 tok/s12 GB, 33 of 66 layers; one run, memory limited on a larger card to simulate the sizeflelink run katy-27b-dflash
Kate 27B + DSpineKaty without the refusal directionfits14.1 tok/s12 GB, 37 of 66 layers; memory limited on a larger card to simulate the sizeflelink run kate-27b-dspine
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBtoo bignot measured on this sizeflelink run fle-iq3-m
DeepSeek V4.1 Flash + DSpark763B mixture of experts, 232 GiBtoo bignot measured on this sizeflelink run deepseek-v41-ista-dspark
Rin (DeepSeek V4.1 Flash, split)763B, hot half on the GPUtoo bignot measured on this sizeflelink run rin-deepseek-v41-dspark

12 GB card with 64 GB of RAM

ModelDoes it fit?Measured on this hardwareOne command
Llama 3.2 1B1B, a first try on any laptopfitsnot measured on this sizeflelink run llama-3.2-1b
Katy 27B + DFlash2dense 27B with a draft modelfits11.2 tok/s12 GB, 33 of 66 layers; one run, memory limited on a larger card to simulate the sizeflelink run katy-27b-dflash
Kate 27B + DSpineKaty without the refusal directionfits14.1 tok/s12 GB, 37 of 66 layers; memory limited on a larger card to simulate the sizeflelink run kate-27b-dspine
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBtightnot measured on this sizeflelink run fle-iq3-m
DeepSeek V4.1 Flash + DSpark763B mixture of experts, 232 GiBtoo bignot measured on this sizeflelink run deepseek-v41-ista-dspark
Rin (DeepSeek V4.1 Flash, split)763B, hot half on the GPUtoo bignot measured on this sizeflelink run rin-deepseek-v41-dspark

12 GB card with 128 GB of RAM

ModelDoes it fit?Measured on this hardwareOne command
Llama 3.2 1B1B, a first try on any laptopfitsnot measured on this sizeflelink run llama-3.2-1b
Katy 27B + DFlash2dense 27B with a draft modelfits11.2 tok/s12 GB, 33 of 66 layers; one run, memory limited on a larger card to simulate the sizeflelink run katy-27b-dflash
Kate 27B + DSpineKaty without the refusal directionfits14.1 tok/s12 GB, 37 of 66 layers; memory limited on a larger card to simulate the sizeflelink run kate-27b-dspine
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBtightnot measured on this sizeflelink run fle-iq3-m
DeepSeek V4.1 Flash + DSpark763B mixture of experts, 232 GiBtoo bignot measured on this sizeflelink run deepseek-v41-ista-dspark
Rin (DeepSeek V4.1 Flash, split)763B, hot half on the GPUtoo bignot measured on this sizeflelink run rin-deepseek-v41-dspark

The verdicts are the rule FLE Link applies before it downloads anything (the rules in full). A speed is shown only for the hardware it was measured on. A size nobody measured yet? flelink bench --task pagoda --share posts yours to the benchmarks board.

Other sizes: 16 GB · 24 GB · 32 GB. Any other GGUF file works with flelink run /path/to/model.gguf; the calculator on the main page takes any size, an Apple Silicon Mac or no GPU.

Install FLE Link

curl -fsSL https://flelink.run/install.sh | sh

Windows: irm https://flelink.run/install.ps1 | iex. Open source, MIT. No account, no telemetry. What FLE Link does →