Forgot to mention that I was testing IPv6 connectivity from a windows 10 machine.
Looking back at it now, I'm not 100% sure that my XB1 was on when I flashed to Beta5 and cleared nvram (then noticed the IPv6 issue). But if it was off, it would have been in Instant-On mode.
Either way, it's...