FLE Link

FLE Link / Your card

What runs on a 32 GB GPU: local AI models that fit

A 32 GB NVIDIA card runs more than its memory suggests. For mixture-of-experts models the FLE engine keeps the experts in RAM and only the busiest ones on the GPU, so the RAM decides which model fits. With 128 GB of RAM the biggest model in the catalog that fits a 32 GB card is Rin (DeepSeek V4.1 Flash, split).

32 GB card with 32 GB of RAM

ModelDoes it fit?Measured on this hardwareOne command
Llama 3.2 1B1B, a first try on any laptopfitsnot measured on this sizeflelink run llama-3.2-1b
Katy 27B + DFlash2dense 27B with a draft modelfits104 tok/sfrom 20 GB up all 66 layers are on the card; one run, engine direct, context 32768, in a machine with 128 GB RAMflelink run katy-27b-dflash
Kate 27B + DSpineKaty without the refusal directionfits142.7 tok/sfrom 20 GB up all 66 layers are on the card; memory limit simulated on a 32 GB card, FLE v1.3.0 source, Nov 2026flelink run kate-27b-dspine
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBtoo bignot measured on this sizeflelink run fle-iq3-m
DeepSeek V4.1 Flash + DSpark763B mixture of experts, 232 GiBtoo bignot measured on this sizeflelink run deepseek-v41-ista-dspark
Rin (DeepSeek V4.1 Flash, split)763B, hot half on the GPUtoo bignot measured on this sizeflelink run rin-deepseek-v41-dspark

32 GB card with 64 GB of RAM

ModelDoes it fit?Measured on this hardwareOne command
Llama 3.2 1B1B, a first try on any laptopfitsnot measured on this sizeflelink run llama-3.2-1b
Katy 27B + DFlash2dense 27B with a draft modelfits104 tok/sfrom 20 GB up all 66 layers are on the card; one run, engine direct, context 32768, in a machine with 128 GB RAMflelink run katy-27b-dflash
Kate 27B + DSpineKaty without the refusal directionfits142.7 tok/sfrom 20 GB up all 66 layers are on the card; memory limit simulated on a 32 GB card, FLE v1.3.0 source, Nov 2026flelink run kate-27b-dspine
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBfitsnot measured on this sizeflelink run fle-iq3-m
DeepSeek V4.1 Flash + DSpark763B mixture of experts, 232 GiBtoo bignot measured on this sizeflelink run deepseek-v41-ista-dspark
Rin (DeepSeek V4.1 Flash, split)763B, hot half on the GPUtoo bignot measured on this sizeflelink run rin-deepseek-v41-dspark

32 GB card with 128 GB of RAM

ModelDoes it fit?Measured on this hardwareOne command
Llama 3.2 1B1B, a first try on any laptopfitsnot measured on this sizeflelink run llama-3.2-1b
Katy 27B + DFlash2dense 27B with a draft modelfits104 tok/sfrom 20 GB up all 66 layers are on the card; one run, engine direct, context 32768, in a machine with 128 GB RAMflelink run katy-27b-dflash
Kate 27B + DSpineKaty without the refusal directionfits142.7 tok/sfrom 20 GB up all 66 layers are on the card; memory limit simulated on a 32 GB card, FLE v1.3.0 source, Nov 2026flelink run kate-27b-dspine
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBfits91 tok/s32 GB card, 128 GB RAM, with the engine's MTP draft head started by hand; flelink run starts it without the head so farflelink run fle-iq3-m
DeepSeek V4.1 Flash + DSpark763B mixture of experts, 232 GiBfits49.9 tok/s32 GB card, 128 GB RAM (120 GB for the model, 8 GB left to the system), through FLE Link, median of three (5 Nov 2026); 37.2 without the draftflelink run deepseek-v41-ista-dspark
Rin (DeepSeek V4.1 Flash, split)763B, hot half on the GPUfits53.4 tok/s32 GB card, 128 GB RAM, FLE v1.2.6; lossy, see the model cardflelink run rin-deepseek-v41-dspark

The verdicts are the rule FLE Link applies before it downloads anything (the rules in full). A speed is shown only for the hardware it was measured on. A size nobody measured yet? flelink bench --task pagoda --share posts yours to the benchmarks board.

Other sizes: 12 GB · 16 GB · 24 GB. Any other GGUF file works with flelink run /path/to/model.gguf; the calculator on the main page takes any size, an Apple Silicon Mac or no GPU.

Install FLE Link

curl -fsSL https://flelink.run/install.sh | sh

Windows: irm https://flelink.run/install.ps1 | iex. Open source, MIT. No account, no telemetry. What FLE Link does →