@tgl, thanks for reply.
The issue is that iOS seems to have terrible bug with 5Ghz networks. As a workaround I need to use 2.4Ghz only for my phone.
While my setup isn't probably ideal, the key issue is not with it. I just turned off all APs except only one and I still get issues with dropping...