FLE Link

FLE Link / Models

Run Qwen3.8-Flash-Next locally on one GPU

Qwen3.8-Flash-Next is a mixture-of-experts model with 125 billion parameters. The FLE quant (FLE-IQ3_M) is an 88.9 GB file, far more than a graphics card holds. The FLE engine keeps the experts in RAM and the busiest ones on the GPU, so the model runs from a 16 GB card and 64 GB of RAM.

flelink run fle-iq3-m

What you need

One NVIDIA card from 16 GB and 64 GB of RAM; the top speed was measured with 32 GB and 128 GB of RAM.

Measured speed

RecipeDecodeMeasured on
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GB91 tok/s32 GB card, 128 GB RAM, with the engine's MTP draft head started by hand; flelink run starts it without the head so far
Qwen3.8-Flash-Next125B mixture of experts, 88.9 GBabout 15 tok/s16 GB card, 64 GB RAM (8 Nov 2026)

Does Qwen3.8-Flash-Next fit my card?

Graphics32 GB RAM64 GB RAM128 GB RAM
12 GB NVIDIA cardtoo bigtighttight
16 GB NVIDIA cardtoo bigfitsfits
24 GB NVIDIA cardtoo bigfitsfits
32 GB NVIDIA cardtoo bigfitsfits
Apple Silicon Macno engineno engineno engine
No GPUno engineno engineno engine

"no engine": this recipe needs the FLE engine, which has an NVIDIA CUDA build only. File size 83 GiB including the draft model.

The verdicts are the rule FLE Link applies before it downloads anything (the rules in full). A speed is shown only for the hardware it was measured on. A size nobody measured yet? flelink bench --task pagoda --share posts yours to the benchmarks board.

Good to know

Sources

Install FLE Link

curl -fsSL https://flelink.run/install.sh | sh

Windows: irm https://flelink.run/install.ps1 | iex. Open source, MIT. No account, no telemetry. What FLE Link does →