I have a few clients with fixed IPs (not any of the ones I tried to connect) but I deleted them just for testing. Didn't help.
Can confirm guest network works perfectly after factory reset. Must be my settings, ugh.
EDIT: After that, I restored my previous settings and guest network started...