You can have both the old and new router running side-by-side, just make sure their IP address is different.
Then, you can either use a big/long monitor to open both config webpage side-by-side, or use dual monitor, or use different computer/laptop/tab to open each. In this way, you can...