Nemotron Labs Dory 1.0 4B on an 8 GB GPU: What Fits and What Does Not
Nemotron Labs Dory 1.0 4B fits an 8 GB GPU in Q5_K_M or FP4 formats, but BF16 does not. Weight sizes, loop trade-offs and what is still unverified.
Nemotron Labs Dory 1.0 4B fits an 8 GB GPU in Q5_K_M or FP4 formats, but BF16 does not. Weight sizes, loop trade-offs and what is still unverified.
Last updated: May 2026. This unified memory AI comparison pits NVIDIA DGX Spark, Apple Mac Studio M4 Ultra, OEM AMD Ryzen AI Max+ 395 desktops, and the GMKtec EVO-X2 mini-PC against each other for buyers who want turnkey unified memory—not PCIe GPU surgery. Runtime claims cite dated sources where they exist: community llama.cpp threads (build … Read more