So right off the bat, the biggest issue with your testing is that you had multiple hops of wireless in the mix, which is a no-no from the simple standpoint of testing a wired router. When doing so, you want to cut out wireless, plus as many unnecessary wired hops in the path as possible. Just knowing that alone, I'm 99% sure the performance depredation you're attributing to the ER-4 was being caused by the iPhone and its radio and/or the AP/router and its radio, and/or your MBP and its radio, if it wasn't wired into ER-4, and/or a switch connected to the ER-4 if you had one.
I would retest with 1 host directly wired to the ER-4, running an iperf server on the host, then use the iperf client on the ER-4 (found under "Tools" in the GUI) to run your test. (Or if you want client control or better reporting, run iperf client on the host, and server on the ER-4). If all is setup properly, I would predict full gigabit wire speed and practically zero latency or jitter.
If you're thinking the ER-4 was performing poorly because it was connected up to all the other devices, you'd have to test speed through the ER-4 and each successive device, added back into the network one by one, and do so then against the DrayTek or whatever router in place of the ER-4. After doing so, I suspect you'd find it's one or all of the wifi clients/stations in the network path that is/are causing the performance issues, and doing so to an equal degree across all routers, regardless of which router you have in place. I could be wrong, but that's really the only way to know for sure.