Please look at the following table from Reddit, it seems to be very useful in explaining why <5% is important https://www.reddit.com/r/LocalLLaMA/comments/1p8p844/tested_quantization_on_my_8gb_potato_laptop_heres/