Diversion - the Router Ad-Blocker

thelonelycoder

Part of the Furniture
Diversion 4.1.12 is now available

What's new in Diversion 4.1.12
- NEW: Additional theme solarized to choose from. Thanks @Stuart MacDonald for the code.
- CHANGED: Enhanced NTP ready check.
- CHANGED: Wording in Diversion update notification email for available amtm third-party scripts.
- CHANGED: Added option to paginate at 5 lines in el.

Note: If you use amtm, update it now for compatibility, the order does not matter.

How to update
Use u to update to this latest version.
 

thelonelycoder

Part of the Furniture
The above Diversion update might not include the long awaited WebUI code, but rest assured its coming.
Coding the new functions into amtm 3.1.7 took much longer but the result is very satisfying to me.
 

JaimeZX

Senior Member
I know Firefox does its own.
 

thelonelycoder

Part of the Furniture
I've pushed a minor update for Diversion, no version change

This fixes the double count in the stats function when IPv6 is enabled.

A pull request for @Jack Yaz uiDivStats will be made shortly.

Use u to update.
 

--Manu--

Occasional Visitor
I've pushed a minor update for Diversion, no version change

This fixes the double count in the stats function when IPv6 is enabled.

A pull request for @Jack Yaz uiDivStats will be made shortly.

Use u to update.
Thanks a lot.

Directly after the update, it double counts the domains (IPv6 on). I had to do a manual block list update to show the correct count (divided by two).
 

KGB7

Very Senior Member
Did you ever test with the f option in Diversion to see what Dnsmasq says?
Your device might use its own "domain to IP resolution" and not go through the routers Dnsmasq.
Doesn't say much.

May 5 01:12:03 dnsmasq[5259]: query[A] keyvalueservice.fe.apple-dns.net from 192.160.100.13
May 5 01:12:03 dnsmasq[5259]: forwarded keyvalueservice.fe.apple-dns.net to 192.168.100.1
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.143.124
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.154
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.168
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.176
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.203
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.208
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.211
 

KGB7

Very Senior Member
Also, if Diversion was down for some amount of time, (at least Firefox) will cache some DNS information, so even when Diversion goes back up if FF has that data for ad servers you'll keep seeing them. Look into flushing the browser DNS caches and that may help. (Source: I've had this happen to me.)
Cleared all caches and dns. Flushed everything, using terminal commands.
In the past, this tactic did work, but its not working for some reason at this time.

All websites did require manually entering credentials; emails, banking, medical, etc etc. So I think I cleared everything out.

The ad overlay on top of YouTube video is something I have never seen before. It could be new and just been implemented by Youtube. But last week I did not see the overlay ads on top of videos. I attached image in my earlier post.

Do you see overlay ads in YouTube videos??

Thanks for the suggestion.
 
Last edited:

KGB7

Very Senior Member
Sometimes the websites themselves change how they deliver ads. Or the public blocking lists change.

What you’re doing isn’t working so gather some facts from the logs.
Unfortunately, Diversion website has limited information and not user friendly. Even though ive been pocking around Diversion settings, I can figure out a way to look at an extensive log.
 

KGB7

Very Senior Member
Apologies for multiple posts in the row, I dont see an option to multi-quote posts.

I reverted back to firmware 384.16 on Asus ac68u. No improvement at this time.

One more thing that I have left to test, is install Diversion using: curl -Os https://diversion.ch/install && sh install. Because I have been installing Diversion from AMTM and thats when I think the issue has started. Its the only thing that I can rule out at this time.

One last question for tonight. Diversion recommends to format USB thumb drive as ext2. Any reason I should not be using ext3 or ext4? I read up on the differences between the 3, but is there a specific reason when it comes to Diversion it self, why I should use ext2? I think in the past I formatted the thumb drive with ext4, because its newer format.

Im really trying to figure this out, and for the first time in a long time, I am stumped.


Thanks again everyone for the help.
 
Last edited:

thelonelycoder

Part of the Furniture
One more thing that I have left to test, is install Diversion using: curl -Os https://diversion.ch/install && sh install. Because I have been installing Diversion from AMTM and thats when I think the issue has started. Its the only thing that I can rule out at this time.
amtm runs the exact same command as the one posted on my website.
 

thelonelycoder

Part of the Furniture
Doesn't say much.

May 5 01:12:03 dnsmasq[5259]: query[A] keyvalueservice.fe.apple-dns.net from 192.160.100.13
May 5 01:12:03 dnsmasq[5259]: forwarded keyvalueservice.fe.apple-dns.net to 192.168.100.1
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.143.124
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.154
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.168
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.176
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.203
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.208
May 5 01:12:03 dnsmasq[5259]: reply keyvalueservice.fe.apple-dns.net is 17.248.134.211
Is that exact domain blocked in Diversion? It's not blocked with the large blocking list in use.
 

thelonelycoder

Part of the Furniture
Unfortunately, Diversion website has limited information and not user friendly. Even though ive been pocking around Diversion settings, I can figure out a way to look at an extensive log.
Enter f in Diversion, it'll give a few options. Select 3. Blocked domains then browse a page with ads, it should show what's blocked.
 

KGB7

Very Senior Member
Enter f in Diversion, it'll give a few options. Select 3. Blocked domains then browse a page with ads, it should show what's blocked.

i This follows the Dnsmasq log file (tail -F)

1. Unfiltered log
2. Unfiltered log extra highlighted
3. Blocked domains
4. Blocked domains, by device IP
5. Term or IP

Enter selection [1-5 e=Exit] 3

i Press Ctrl-C to exit

04:35:21 blocked by blockinglist sdk.split.io
04:35:41 blocked by blockinglist googleads.g.doubleclick.net
04:35:43 blocked by blockinglist static.doubleclick.net
04:36:21 blocked by blockinglist events.split.io
04:36:21 blocked by blockinglist sdk.split.io
04:37:05 blocked by blockinglist clksite.com
04:37:22 blocked by blockinglist sdk.split.io
04:37:42 blocked by blockinglist googleads.g.doubleclick.net
04:38:22 blocked by blockinglist sdk.split.io
04:39:22 blocked by blockinglist sdk.split.io
04:39:48 blocked by blockinglist googleads.g.doubleclick.net
----------------------------------------------------------------------------

This is what I get when I have 3 tabs open to this site, to YouTube site and to 3rd site.
 

KGB7

Very Senior Member
Is that exact domain blocked in Diversion? It's not blocked with the large blocking list in use.

i This follows the Dnsmasq log file (tail -F)

1. Unfiltered log
2. Unfiltered log extra highlighted
3. Blocked domains
4. Blocked domains, by device IP
5. Term or IP

Enter selection [1-5 e=Exit] 2

i Press Ctrl-C to exit

May 5 04:41:22 dnsmasq[5259]: query[A] sdk.split.io from 192.160.100.13
May 5 04:41:22 dnsmasq[5259]: blocked by blockinglist sdk.split.io is 192.160.100.4
May 5 04:41:36 dnsmasq[5259]: query[A] time-macos.apple.com from 192.160.100.13
May 5 04:41:36 dnsmasq[5259]: forwarded time-macos.apple.com to 192.168.100.1
May 5 04:41:36 dnsmasq[5259]: reply time-macos.apple.com is <CNAME>
May 5 04:41:36 dnsmasq[5259]: reply time-osx.g.aaplimg.com is 17.253.20.253
May 5 04:41:36 dnsmasq[5259]: reply time-osx.g.aaplimg.com is 17.253.14.125
May 5 04:41:36 dnsmasq[5259]: reply time-osx.g.aaplimg.com is 17.253.14.251
May 5 04:41:36 dnsmasq[5259]: reply time-osx.g.aaplimg.com is 17.253.14.253
May 5 04:41:36 dnsmasq[5259]: reply time-osx.g.aaplimg.com is 17.253.20.125
May 5 04:42:20 dnsmasq[5259]: query[PTR] lb._dns-sd._udp.0.100.160.192.in-addr.arpa from 192.160.100.13
May 5 04:42:20 dnsmasq[5259]: forwarded lb._dns-sd._udp.0.100.160.192.in-addr.arpa to 192.168.100.1
May 5 04:42:22 dnsmasq[5259]: query[A] sdk.split.io from 192.160.100.13
May 5 04:42:22 dnsmasq[5259]: blocked by blockinglist sdk.split.io is 192.160.100.4
May 5 04:42:50 dnsmasq[5259]: query[A] gspe35-ssl.ls.apple.com from 192.160.100.13
May 5 04:42:50 dnsmasq[5259]: forwarded gspe35-ssl.ls.apple.com to 192.168.100.1
May 5 04:42:50 dnsmasq[5259]: reply gspe35-ssl.ls.apple.com is <CNAME>
May 5 04:42:50 dnsmasq[5259]: reply gspe35-ssl.ls-apple.com.akadns.net is <CNAME>
May 5 04:42:50 dnsmasq[5259]: reply gspe35-ssl.ls.apple.com.edgekey.net is <CNAME>
May 5 04:42:50 dnsmasq[5259]: reply e6987.e9.akamaiedge.net is 184.24.151.149
May 5 04:43:00 dnsmasq[5259]: query[A] safebrowsing.googleapis.com from 192.160.100.13
May 5 04:43:00 dnsmasq[5259]: forwarded safebrowsing.googleapis.com to 192.168.100.1
May 5 04:43:00 dnsmasq[5259]: reply safebrowsing.googleapis.com is 64.233.185.95
May 5 04:43:22 dnsmasq[5259]: query[A] sdk.split.io from 192.160.100.13
May 5 04:43:22 dnsmasq[5259]: blocked by blockinglist sdk.split.io is 192.160.100.4
May 5 04:44:23 dnsmasq[5259]: query[A] sdk.split.io from 192.160.100.13
May 5 04:44:23 dnsmasq[5259]: blocked by blockinglist sdk.split.io is 192.160.100.4
May 5 04:45:23 dnsmasq[5259]: query[A] sdk.split.io from 192.160.100.13
May 5 04:45:23 dnsmasq[5259]: blocked by blockinglist sdk.split.io is 192.160.100.4
May 5 04:45:37 dnsmasq[5259]: query[A] init.push.apple.com from 192.160.100.13
May 5 04:45:37 dnsmasq[5259]: forwarded init.push.apple.com to 192.168.100.1
May 5 04:45:37 dnsmasq[5259]: reply init.push.apple.com is <CNAME>
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.164.220
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.166.108
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.166.160
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.167.215
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.161.93
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.161.184
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.163.28
May 5 04:45:37 dnsmasq[5259]: reply init.push-apple.com.akadns.net is 17.188.163.211

---------------------------------------------------------------------------------------------------
 
Last edited:

dave14305

Part of the Furniture
May 5 04:43:00 dnsmasq[5259]: forwarded safebrowsing.googleapis.com to 192.168.100.1
What is 192.168.100.1? It’s unusual for an upstream DNS server from your WAN settings.
 

JaimeZX

Senior Member
Do you see overlay ads in YouTube videos??
Thanks for the suggestion.
Yes, we're not aware of any way to get rid of them. Not all videos have ads though. Depends on who posts the video and what their settings are, IIRC.
 

JaimeZX

Senior Member
Does Skynet work?
Is your external drive mounted? (Does it show up as mounted in the GUI? What about fdisk -l ?)
 

bluepoint

Very Senior Member
Cleared all caches and dns. Flushed everything, using terminal commands.
In the past, this tactic did work, but its not working for some reason at this time.

All websites did require manually entering credentials; emails, banking, medical, etc etc. So I think I cleared everything out.

The ad overlay on top of YouTube video is something I have never seen before. It could be new and just been implemented by Youtube. But last week I did not see the overlay ads on top of videos. I attached image in my earlier post.

Do you see overlay ads in YouTube videos??

Thanks for the suggestion.
Yes, overlay ads in youtube are normal, it depends on the video you're watching, sometimes they have sometimes they don't. Diversion does not block these kind of ads in youtube. Sometimes you'll see blank placeholder, when this happens it means Diversion blocked the content but not the placeholder and to get it out of the way click the x. If you want to watch youtube ads free, use a browser extension like uBlock Origin, it works.
 

Latest threads

Sign Up For SNBForums Daily Digest

Get an update of what's new every day delivered to your mailbox. Sign up here!
Top