I was making my post and going through what I actually used in the settings and came across this and was reminded that it exists lol.In this case as a workaround activate Dual WAN and move the Primary WAN to LAN 1 port. Continue using the router as usual after.
I would just have to put my work PC on the old WAN port since that one is fine to be at 100 Mbps, and then all my personal stuff can be faster.
Definitely going to try this, but still would prefer a fully functioning router.