Critical constraint: 8.22 GB total RAM with no GPU. A 7B model in FP16 requires ~14 GB RAM — naive baseline load will OOM. AirLLM layer-paging and GGUF Q4 quantization are the primary mitigations.

While Windows is a supported platform for UniFi OS Server, Docker updates or other issues can occasionally prevent the service from starting as expected. If the system needs to remain available at all ...