Diversion Diversion - the Router Ad-Blocker

[thelonelycoder]

It says blocked www.googleadservices.com
yet browser still loads ads from https://www.googleadservices.com

yup flushed browser cache pc cache

Is Dversion Lite or Standard installed? The Lite Edition does not block https ads.

You can upgrade it in d.

 

[sahilg009]

Standard

 

[tomsk]

are these domains whitelisted? .... some domains are whitelisted to support SNB

 

[Sbfnu]

It may have asked (or answered) somewhere else but I haven't found that yet - so I ask for your help?

How to find out what blacklisted domain causes trouble on a client?

For example, my wife's Amazon app doesn't display all information any longer since I enabled Diversion (using the standard blockfiles) but shows broken Internet connection.

How can I find out what blocked domain is causing that error - so that I can solve it by adding that domain to the whitelist?

 

[Protik]

I changed the IP of pixelserv-tls using ep from 192.168.2.2 to 192.168.2.3. That was successful but still Diversion is sending the HTTPS ads to 192.168.2.2 (as shown in menu a) . How can I change the IP to 192.168.2.3?

It seems changing the IP within the ep menu does not update the IPs within the blocking file.

Here is the UI,

 Diversion 4.0.3                  by thelonelycoder

 RT-AC68U (armv7l) FW-384.7 @ 192.168.2.1 IPv6

 801,892  blocked domains  6  hosts file(s) in use
 120,951 t  18,666 w  5,642 n ads since Oct 22 05:20
____________________________________________________

 d   Diversion Standard   enabled
 c   communication        DivUn stats backup FWun

 a   ad-blocking          to IP 192.168.2.2
 l   logging              /opt/var/log/dnsmasq.log

 ep  pixelserv-tls        192.168.2.3 v2.2.0

 b   blocking file        Standard+ Sun @ 2:00
 el  edit lists

 f   follow dnsmasq.log

 e   exit Diversion                 more options  o
____________________________________________________

 What do you want to do?

Here is the diversion.conf file,

Spoiler: diversion.conf

/opt/share/diversion/.conf/diversion.conf has this content:

START FILE, --- lines are not part of file
---------------------------------------------------
## DO NOT EDIT THIS FILE ##
# General settings #
NAME=Diversion
thisVERSION=4.0
thisM_VERSION=3
EDITION=Standard
THEME=blue
INSTALL_URL=
DIVERSION_STATUS=disabled
adblocking=on
logging=on
editorColor=
editorPaginate=
editorAutowww=
shHistory=on
# Communication settings #
divUpdate=on
weeklyStats=on
wsTo="email"
wsAs="body"
wsDo="delete"
wsTopHosts=10
wsTopClients=10
wsFilterLN=off
backup=on
buFrequency=weekly
buType="Key-files"
buAs=compressed
buCompression=tar.gz
# Blocking file settings #
bfType=Standard
bfPlusHosts=on
bfUpdateDay=Sunday
bfUpdateDOW=Sun
bfUpdateHour=2
bfUpdateLastRun="Oct 23 00:36:35"
bfUpdatePrevRun=""
blockingIP="192.168.2.2"
# Entware settings #
entPath="/mnt/pdas001/entware"
entVersion="Entware (armv7sf-k2.6)"
psState=on
prevPsState=on
psIP="192.168.2.3"
# Ad-blocking counters #
blockedDomains=800388
adsBlocked=120951
adsWeek=18666
adsNew=5642
adsPrevCount="Oct 22 05:20"
adsLastCount="Oct 22 17:20"
adsCounter=off
# Dnsmasq settings #
dsSetting=on
logAsync=
cacheSize=
bogusPriv=
domainNeeded=
loqQueriesExtra=
# Messaging #
---------------------------------------------------
END FILE

 

[Hadean]

Awesome piece of software! First, thank you for this - my household definitely appreciates it.

I just wanted to make a note, though, that the adblocking appears to have mail.gandi.net and webredir.vip.gandi.net in the list, which caused no end of confusion for a while since we use those for our email and website hosting (I didn't equate ad blocking to not getting my email). Is this the place to report things like this?

Anyway, thanks again!

 

[M@rco]

I just wanted to make a note, though, that the adblocking appears to have mail.gandi.net and webredir.vip.gandi.net in the list, which caused no end of confusion for a while since we use those for our email and website hosting (I didn't equate ad blocking to not getting my email). Is this the place to report things like this?

It's no use reporting here, as Diversion uses blocking lists composed by others. Simply whitelist them in Diversion using el from the main menu, followed by 1, 1. Don't forget to process the whitelist using 3 once you're done adding domains to the whitelist.

Edit: typo

 

[Hadean]

It's no use reporting here, as Diversion uses blocking lists composed by others. Simply whitelist them in Diversion using el from the main menu, followed by 1, 1. Don't forget to process the whitelist using 3 once your done adding domains to the whitelist.

Perfect, thanks! Curious why they were added, but at least they won't get in the way anymore.

 

[thelonelycoder]

It says blocked www.googleadservices.com
yet browser still loads ads from https://www.googleadservices.com

yup flushed browser cache pc cache

From the device that still shows the ads, do a ping to these. It should return the blocking IP.

ping www.googleadservices.com
ping googleads.g.doubleclick.net

If not, your device may use alternate DNS Servers.
On Windows you may want to flush the DNS Cache with:

ipconfig /flushdns

 

[thelonelycoder]

are these domains whitelisted? .... some domains are whitelisted to support SNB

None of these are whitelisted by default.

The default list in Diversion is:

aax-eu.amazon-adsystem.com # whitelisted for smallnetbuilder.com
aax-us-east.amazon-adsystem.com # whitelisted for smallnetbuilder.com
ad2.netshelter.net # whitelisted for smallnetbuilder.com
assets.omidoo.com # whitelisted for smallnetbuilder.com
flashtalking.com # whitelisted for smallnetbuilder.com
fls-na.amazon-adsystem.com # whitelisted for smallnetbuilder.com
images-na.ssl-images-amazon.com # whitelisted for smallnetbuilder.com
ir-na.amazon-adsystem.com # whitelisted for smallnetbuilder.com
ir-uk.amazon-adsystem.com # whitelisted for smallnetbuilder.com
pagead2.googlesyndication.com # whitelisted for smallnetbuilder.com
servedby.flashtalking.com # whitelisted for smallnetbuilder.com
tgdaily.com # whitelisted for smallnetbuilder.com
tgdaily.net # whitelisted for smallnetbuilder.com
vma.tgdaily.com # whitelisted for smallnetbuilder.com
vma.tgdaily.net # whitelisted for smallnetbuilder.com
wms-eu.amazon-adsystem.com # whitelisted for smallnetbuilder.com
wms-na.amazon-adsystem.com # whitelisted for smallnetbuilder.com
wms-na.assoc-amazon.com # whitelisted for smallnetbuilder.com
ws-eu.amazon-adsystem.com # whitelisted for smallnetbuilder.com
ws-na.amazon-adsystem.com # whitelisted for smallnetbuilder.com
z-na.amazon-adsystem.com # whitelisted for smallnetbuilder.com

 

[thelonelycoder]

It may have asked (or answered) somewhere else but I haven't found that yet - so I ask for your help?

How to find out what blacklisted domain causes trouble on a client?

For example, my wife's Amazon app doesn't display all information any longer since I enabled Diversion (using the standard blockfiles) but shows broken Internet connection.

How can I find out what blocked domain is causing that error - so that I can solve it by adding that domain to the whitelist?

Use f, whichever option is right for you. The options 1 or 2 seem to be the best. Note the IP address of the (wife's) device and have her browse in the Amazon app.
Look which ones are blocked related to the IP. Whitelist and try again. Delete it in the whitelist if it's still not working, trying the next one. Repeat until found.

 

[thelonelycoder]

I changed the IP of pixelserv-tls using ep from 192.168.2.2 to 192.168.2.3. That was successful but still Diversion is sending the HTTPS ads to 192.168.2.2 (as shown in menu a) . How can I change the IP to 192.168.2.3?

It seems changing the IP within the ep menu does not update the IPs within the blocking file.

Here is the UI,

 Diversion 4.0.3                  by thelonelycoder

 RT-AC68U (armv7l) FW-384.7 @ 192.168.2.1 IPv6

 801,892  blocked domains  6  hosts file(s) in use
 120,951 t  18,666 w  5,642 n ads since Oct 22 05:20
____________________________________________________

 d   Diversion Standard   enabled
 c   communication        DivUn stats backup FWun

 a   ad-blocking          to IP 192.168.2.2
 l   logging              /opt/var/log/dnsmasq.log

 ep  pixelserv-tls        192.168.2.3 v2.2.0

 b   blocking file        Standard+ Sun @ 2:00
 el  edit lists

 f   follow dnsmasq.log

 e   exit Diversion                 more options  o
____________________________________________________

 What do you want to do?

Here is the diversion.conf file,

Spoiler: diversion.conf

/opt/share/diversion/.conf/diversion.conf has this content:

START FILE, --- lines are not part of file
---------------------------------------------------
## DO NOT EDIT THIS FILE ##
# General settings #
NAME=Diversion
thisVERSION=4.0
thisM_VERSION=3
EDITION=Standard
THEME=blue
INSTALL_URL=
DIVERSION_STATUS=disabled
adblocking=on
logging=on
editorColor=
editorPaginate=
editorAutowww=
shHistory=on
# Communication settings #
divUpdate=on
weeklyStats=on
wsTo="email"
wsAs="body"
wsDo="delete"
wsTopHosts=10
wsTopClients=10
wsFilterLN=off
backup=on
buFrequency=weekly
buType="Key-files"
buAs=compressed
buCompression=tar.gz
# Blocking file settings #
bfType=Standard
bfPlusHosts=on
bfUpdateDay=Sunday
bfUpdateDOW=Sun
bfUpdateHour=2
bfUpdateLastRun="Oct 23 00:36:35"
bfUpdatePrevRun=""
blockingIP="192.168.2.2"
# Entware settings #
entPath="/mnt/pdas001/entware"
entVersion="Entware (armv7sf-k2.6)"
psState=on
prevPsState=on
psIP="192.168.2.3"
# Ad-blocking counters #
blockedDomains=800388
adsBlocked=120951
adsWeek=18666
adsNew=5642
adsPrevCount="Oct 22 05:20"
adsLastCount="Oct 22 17:20"
adsCounter=off
# Dnsmasq settings #
dsSetting=on
logAsync=
cacheSize=
bogusPriv=
domainNeeded=
loqQueriesExtra=
# Messaging #
---------------------------------------------------
END FILE

That's a bug, thanks for reporting.
Will be fixed in the next update.

For now, just disable pixelserv-tls in ep and re-enable it.
Also, the variable INSTALL_URL= is empty in your diversion.conf. Did you delete the url just for this post or is it indeed empty?

 

[Protik]

That's a bug, thanks for reporting.
Will be fixed in the next update.

For now, just disable pixelserv-tls in ep and re-enable it.
Also, the variable INSTALL_URL= is empty in your diversion.conf. Did you delete the url just for this post or is it indeed empty?

That fixed it. Thanks!

No, I did not change anything. Interestingly I checked again and now it's not empty. Now the value is,
INSTALL_URL=https://diversion.ch/diversion

 

[consorts]

Amazon app

i'm noticing weirdness during amazon checkout in a pc based chrome browser, ever since i added skynet to diversion.
it takes 2-3 tries to delete stuff from checkout and even get to the checkout page takes a few tries for some odd reason.
i'm not complaining, just adding my observations here.

UPDATE: sorry about this post, it seems this was a one day issue, now my cart is behaving.

 

[Sbfnu]

Use f, whichever option is right for you. The options 1 or 2 seem to be the best. Note the IP address of the (wife's) device and have her browse in the Amazon app.
Look which ones are blocked related to the IP.

Exactly that is my point: Where and how to look for finding out which domains are blocked - e.g. from my Windows PC?

 

[thelonelycoder]

Exactly that is my point: Where and how to look for finding out which domains are blocked - e.g. from my Windows PC?

Do as I explained. I use option 2 here for extra highlighting.

In this screenshot, a query (blue, query[A] watson.telemetry.microsoft.com from 172.20.0.16) was made from the device with IP 172.20.0.16 and is blocked by the blockinglist (red, next line, blocked by blockinglist watson.telemetry.microsoft.com is 172.20.0.2).

 

[Sbfnu]

Do as I explained. I use option 2 here for extra highlighting.

In this screenshot, a query (blue, query[A] watson.telemetry.microsoft.com from 172.20.0.16) was made from the device with IP 172.20.0.16 and is blocked by the blockinglist (red, next line, blocked by blockinglist watson.telemetry.microsoft.com is 172.20.0.2).

Your are awesome - thank you!

 

[consorts]

using el from the main menu, followed by 1, 1.

coder,
i suggest you change the main "el edit lists" menu item to
"el edit (white/black) lists"
most new to your program have no idea where
something as basic as white listing is hidden.
till i read your comment, i thought i had to do it in Skynet
because Skynet has a more obvious white/black listed menu.
i kept thinking "edit lists" had to do with what hosts file i used.

also, "el" and "e1" look very similar using fixed fonts in PuTTY
so i keep typing e1 and getting the "input is not an option"
you could change that error to "menu does not use numbers"
when it detects any numeral in that menu entry context,
since nothing in your main menu has a number in it.

you could always capitalize the menu (but not require caps)
as EL and E1 are not so mistake-able.

just suggestions to make things more idiot proof...

 

[M@rco]

I think 'most new to Diversion' should just RTFM. The instructions at https://diversion.ch are very clear, in my humble opinion.

As the menu also has some hidden numeral options, 'menu does not use numbers' is not really an option. As for the characters, even I (with my rhinestone glasses) can see the difference between 1 and l in Diversion. It really helps to just keep in mind that all the visible menu options on the homescreen of Diversion require only alphabetic input (but it accepts alphanumeric input). Once you select an option from the menu, the input changes to only numeric input. Once you're used to that, it makes perfect sense and prevents you against erronous input.

 

[thelonelycoder]

also, "el" and "e1" look very similar using fixed fonts in PuTTY
so i keep typing e1 and getting the "input is not an option"
you could change that error to "menu does not use numbers"
when it detects any numeral in that menu entry context,
since nothing in your main menu has a number in it.

Simce nothing in the main menu has a numer, don't use a number. One should be able to memorize that.
No way I'm going to change the way it is. This is the first complaint I ever heard or read about my choice of the menu names or selectors..