Thanks for the advice.
After playing with the settings in ROUTER 2, I figured out disabling Lan -> Switch Control -> NAT Acceleration solves the problem. However, I just don't understand why disabling Wan -> Internet Connection -> Enable NAT isn't enough despite that the iptables looks clean...