Do not use media server, samba or ftp, below is the location in the file, domain= is line 13
min-port=4096
domain=<ROUTER HOSTNAME>
expand-hosts
It does not look like this was the cause anyway, more of a placebo effect of dnsmasq being restarted, max response time has hit 153ms since...