While I was fiddling around with wifi adapter settings I switched off QoS and got stuck at a very low 5g speed, back to Auto(=On) got me back to the max.
Ymmv, but I find it awkward this has such a big impact, but maybe this helps someone with speed issues