I've accidentally found out that this setting seems to be ignored. I set:
Forward local domain queries to upstream DNS: No
But querying for local hosts/IPs in the router itself, it still forwards those queries to upstream DNS:
admin@RT-AC68U-9520:/tmp/home/root# nslookup dc
Server: 8.8.8.8...