Diversion Diversion - the Router Ad-Blocker

[Beherit]

I see no reason why Diversion would not run with your entries.
But do you know why you added these lines? What are the benefits/what for?

I'm certain I've not done any changes by myself. I think its ntpMerlin that added them.

Also it could be that your local NTP server comes up late, preventing other things to run on time.
Of interest would be Syslog entries when Diversion fails to start, I'm sure it would tell a clear story of why it happens.

Is there any way to access the syslog entries? I was under the impression that the syslogs are cleared and gone forever once the device reboots, that they aren't saved on any drive. Because if I boot with Diversion installed and enabled, I cannot access the router by SSH, webUI or any other means.

 

[thelonelycoder]

I'm certain I've not done any changes by myself. I think its ntpMerlin that added them.

Is there any way to access the syslog entries? I was under the impression that the syslogs are cleared and gone forever once the device reboots, that they aren't saved on any drive. Because if I boot with Diversion installed and enabled, I cannot access the router by SSH, webUI or any other means.

/tmp/syslog.log is the most recent Syslog file. It gets copied over to /jffs/syslog.log at intervals. The latter is the one to look at after your mysterious happenings. There's also an syslog.log-1 in each location which presumably goes even further back.

 

[Ubimo]

Something is hogging my router.
I see "diversion" in the second and fourth screenshot:

https://imgur.com/HHLYHiP
https://imgur.com/PPG3250
https://imgur.com/OSOqzCz
https://imgur.com/aUYB17D
https://imgur.com/mgt0z2F

What's causing the high CPU load?

Edit:
I disabled Diversion logging, the CPU load is low again.
In Diversion menu, I saw dnsmasq.log was 133MB.

 

[thelonelycoder]

Something is hogging my router.
I see "diversion" in the second and fourth screenshot:

https://imgur.com/HHLYHiP
https://imgur.com/PPG3250
https://imgur.com/OSOqzCz
https://imgur.com/aUYB17D
https://imgur.com/mgt0z2F

What's causing the high CPU load?

Edit:
I disabled Diversion logging, the CPU load is low again.
In Diversion menu, I saw dnsmasq.log was 133MB.

Is uiDivStats installed, an old version maybe?
@Jack Yaz does this look familiar to you?

 

[Jack Yaz]

Is uiDivStats installed, an old version maybe?
@Jack Yaz does this look familiar to you?

Could be v1, sed -n only appears in one place in v2 regarding lock file management

 

[Ubimo]

uiDivStats is not installed.

 

[Khadanja]

Does anyone see anything under blocked YouTube blacklist in uidivstats. I've had YouTube ad blocking enabled for a few days but I see nothing. I see 141 in yt_blacklist. Not sure if it's even working as sometime I see ads & sometimes I don't.

 

[Skeptical.me]

Hi all.

Symptoms: on my Twitter feed (iMac App) pictures to links, video, Giff's intermittency stop displaying (for hours). And strangely when I click on links (anything requesting a server response) there is a delay .... this is happening on ALL devices. And these things have only started since I updated to Merlin 384.18 two days ago.

I'm not sure if these things are Diversion related but I'm really unsure of what else would cause this.

 

[Asad Ali]

Hi all.

Symptoms: on my Twitter feed (iMac App) pictures to links, video, Giff's intermittency stop displaying (for hours). And strangely when I click on links (anything requesting a server response) there is a delay .... this is happening on ALL devices. And these things have only started since I updated to Merlin 384.18 two days ago.

I'm not sure if these things are Diversion related but I'm really unsure of what else would cause this.

Disable Diversion and test again.

 

[miazza]

Disable Diversion and test again.

Since when I disabled uidivstats I drastically reduced the CPU load.

 

[no_name]

Hi all.

Symptoms: on my Twitter feed (iMac App) pictures to links, video, Giff's intermittency stop displaying (for hours). And strangely when I click on links (anything requesting a server response) there is a delay .... this is happening on ALL devices. And these things have only started since I updated to Merlin 384.18 two days ago.

I'm not sure if these things are Diversion related but I'm really unsure of what else would cause this.

I’ve been experiencing the same with twitter on my iPad for a couple of months, I’ve rebooted the router which works sometimes, disabled diversion, unbound, I’ve enabled DOT using Quad 9, Cloudflare, I turn ExpressVPN DNS on or off and it still happens. I have found temporarily turning my adguard app on which changes the DNS to Google DNS over HTTPS or using Virgin Medias DNS then Twitter displays properly every time. I put it down to Twitter not liking my DNS settings


Sent from my iPad using Tapatalk

 

[Skeptical.me]

I’ve been experiencing the same with twitter on my iPad for a couple of months, I’ve rebooted the router which works sometimes, disabled diversion, unbound, I’ve enabled DOT using Quad 9, Cloudflare, I turn ExpressVPN DNS on or off and it still happens. I have found temporarily turning my adguard app on which changes the DNS to Google DNS over HTTPS or using Virgin Medias DNS then Twitter displays properly every time. I put it down to Twitter not liking my DNS settings


Sent from my iPad using Tapatalk

I might try all those things as well, it's happening on my iPad, iPhone, iMac, and PC. The only thing I can relate it to is the router, but maybe it is as you say a conflict with the DNS provider.


Sent from my iPhone using Tapatalk Pro

 

[Skeptical.me]

Disable Diversion and test again.

Will do, thank you


Sent from my iPhone using Tapatalk Pro

 

[Beherit]

/tmp/syslog.log is the most recent Syslog file. It gets copied over to /jffs/syslog.log at intervals. The latter is the one to look at after your mysterious happenings. There's also an syslog.log-1 in each location which presumably goes even further back.

I did another clean install, without changing anything, not even rebooting the router before installing.

..And now it works. I've no clue what could had caused my grief earlier on with Diversion.

Thank you very much @thelonelycoder, now I know how to troubleshoot in the future if needed.

 

[Skeptical.me]

Disable Diversion and test again.

As soon as I disabled Diversion I refreshed the (Offical) Twitter Apps on my iPhone, iPad, and iMac. They're all loading images, and other profile data correctly again.


Sent from my iPhone using Tapatalk Pro

 

[ugandy]

As soon as I disabled Diversion I refreshed the (Offical) Twitter Apps on my iPhone, iPad, and iMac. They're all loading images, and other profile data correctly again.


Sent from my iPhone using Tapatalk Pro

maybe these apps detect that you are not displaying ads, and block/slow other data?

 

[Skeptical.me]

maybe these apps detect that you are not displaying ads, and block/slow other data?

On the iOS Apps I still get "promoted" Tweets which are Ads. But I don't appear to get them on the Twitter Mac App, so I'm not sure.

And about a few minutes after I re-enable Diversion the photos/videos/GIF's all disappear again. And what's even stranger is the profile bio's, followers and following data also disappears.

Really scratching my head over this one.

Sent from my iPhone using Tapatalk Pro

 

[Asad Ali]

As soon as I disabled Diversion I refreshed the (Offical) Twitter Apps on my iPhone, iPad, and iMac. They're all loading images, and other profile data correctly again.


Sent from my iPhone using Tapatalk Pro

Your block file contains some domains which are needed for Twitter. Use Diversion follow log by blocked domains feature and try to track it down.

 

[Skeptical.me]

Your block file contains some domains which are needed for Twitter. Use Diversion follow log by blocked domains feature and try to track it down.

Thanks for the reply,


I followed f > 3. Blocked Domains and started randomly viewing tweets and refreshing the main feed:

04:47:58 blocked by wc-blacklist star.c10r.facebook.com
 04:48:13 blocked by wc-blacklist star.c10r.facebook.com
 04:48:28 blocked by wc-blacklist star.c10r.facebook.com
 04:48:43 blocked by wc-blacklist star.c10r.facebook.com
 04:48:58 blocked by wc-blacklist star.c10r.facebook.com
 04:49:13 blocked by wc-blacklist star.c10r.facebook.com
 04:49:28 blocked by wc-blacklist star.c10r.facebook.com
 04:49:36 blocked by blockinglist ping.chartbeat.net
 04:49:43 blocked by wc-blacklist star.c10r.facebook.com
 04:49:58 blocked by wc-blacklist star.c10r.facebook.com
 04:50:13 blocked by wc-blacklist star.c10r.facebook.com
 04:50:19 blocked by blockinglist analytics.twitter.com
 04:50:28 blocked by wc-blacklist star.c10r.facebook.com
 04:50:43 blocked by wc-blacklist star.c10r.facebook.com
 04:50:58 blocked by wc-blacklist star.c10r.facebook.com
 04:51:13 blocked by wc-blacklist star.c10r.facebook.com
 04:51:28 blocked by wc-blacklist star.c10r.facebook.com
 04:51:42 blocked by blockinglist ping.chartbeat.net
 04:51:43 blocked by wc-blacklist star.c10r.facebook.com
 04:51:58 blocked by wc-blacklist star.c10r.facebook.com
 04:52:13 blocked by blockinglist telemetry.malwarebytes.com
 04:52:13 blocked by wc-blacklist star.c10r.facebook.com
 04:52:28 blocked by wc-blacklist star.c10r.facebook.com
 04:52:43 blocked by wc-blacklist star.c10r.facebook.com
 04:52:45 blocked by blockinglist ping.chartbeat.net
 04:52:58 blocked by wc-blacklist star.c10r.facebook.com
 04:53:13 blocked by wc-blacklist star.c10r.facebook.com
 04:53:28 blocked by wc-blacklist star.c10r.facebook.com
 04:53:43 blocked by wc-blacklist star.c10r.facebook.com
 04:53:58 blocked by wc-blacklist star.c10r.facebook.com
 04:54:13 blocked by wc-blacklist star.c10r.facebook.com
 04:54:28 blocked by wc-blacklist star.c10r.facebook.com
 04:54:43 blocked by wc-blacklist star.c10r.facebook.com
 04:54:58 blocked by wc-blacklist star.c10r.facebook.com
 04:55:13 blocked by wc-blacklist star.c10r.facebook.com
 04:55:28 blocked by wc-blacklist star.c10r.facebook.com
 04:55:43 blocked by wc-blacklist star.c10r.facebook.com
 04:55:58 blocked by wc-blacklist star.c10r.facebook.com
 04:56:13 blocked by wc-blacklist star.c10r.facebook.com
 04:56:28 blocked by wc-blacklist star.c10r.facebook.com
 04:56:43 blocked by wc-blacklist star.c10r.facebook.com
 04:56:58 blocked by wc-blacklist star.c10r.facebook.com
 04:57:13 blocked by wc-blacklist star.c10r.facebook.com
 04:57:28 blocked by wc-blacklist star.c10r.facebook.com
 04:57:43 blocked by wc-blacklist star.c10r.facebook.com
 04:57:58 blocked by wc-blacklist star.c10r.facebook.com
 04:58:13 blocked by wc-blacklist star.c10r.facebook.com

Looks like blocking this FB domain may be the issue.

 

[Asad Ali]

Thanks for the reply,


I followed f > 3. Blocked Domains and started randomly viewing tweets and refreshing the main feed:

04:47:58 blocked by wc-blacklist star.c10r.facebook.com
 04:48:13 blocked by wc-blacklist star.c10r.facebook.com
 04:48:28 blocked by wc-blacklist star.c10r.facebook.com
 04:48:43 blocked by wc-blacklist star.c10r.facebook.com
 04:48:58 blocked by wc-blacklist star.c10r.facebook.com
 04:49:13 blocked by wc-blacklist star.c10r.facebook.com
 04:49:28 blocked by wc-blacklist star.c10r.facebook.com
 04:49:36 blocked by blockinglist ping.chartbeat.net
 04:49:43 blocked by wc-blacklist star.c10r.facebook.com
 04:49:58 blocked by wc-blacklist star.c10r.facebook.com
 04:50:13 blocked by wc-blacklist star.c10r.facebook.com
 04:50:19 blocked by blockinglist analytics.twitter.com
 04:50:28 blocked by wc-blacklist star.c10r.facebook.com
 04:50:43 blocked by wc-blacklist star.c10r.facebook.com
 04:50:58 blocked by wc-blacklist star.c10r.facebook.com
 04:51:13 blocked by wc-blacklist star.c10r.facebook.com
 04:51:28 blocked by wc-blacklist star.c10r.facebook.com
 04:51:42 blocked by blockinglist ping.chartbeat.net
 04:51:43 blocked by wc-blacklist star.c10r.facebook.com
 04:51:58 blocked by wc-blacklist star.c10r.facebook.com
 04:52:13 blocked by blockinglist telemetry.malwarebytes.com
 04:52:13 blocked by wc-blacklist star.c10r.facebook.com
 04:52:28 blocked by wc-blacklist star.c10r.facebook.com
 04:52:43 blocked by wc-blacklist star.c10r.facebook.com
 04:52:45 blocked by blockinglist ping.chartbeat.net
 04:52:58 blocked by wc-blacklist star.c10r.facebook.com
 04:53:13 blocked by wc-blacklist star.c10r.facebook.com
 04:53:28 blocked by wc-blacklist star.c10r.facebook.com
 04:53:43 blocked by wc-blacklist star.c10r.facebook.com
 04:53:58 blocked by wc-blacklist star.c10r.facebook.com
 04:54:13 blocked by wc-blacklist star.c10r.facebook.com
 04:54:28 blocked by wc-blacklist star.c10r.facebook.com
 04:54:43 blocked by wc-blacklist star.c10r.facebook.com
 04:54:58 blocked by wc-blacklist star.c10r.facebook.com
 04:55:13 blocked by wc-blacklist star.c10r.facebook.com
 04:55:28 blocked by wc-blacklist star.c10r.facebook.com
 04:55:43 blocked by wc-blacklist star.c10r.facebook.com
 04:55:58 blocked by wc-blacklist star.c10r.facebook.com
 04:56:13 blocked by wc-blacklist star.c10r.facebook.com
 04:56:28 blocked by wc-blacklist star.c10r.facebook.com
 04:56:43 blocked by wc-blacklist star.c10r.facebook.com
 04:56:58 blocked by wc-blacklist star.c10r.facebook.com
 04:57:13 blocked by wc-blacklist star.c10r.facebook.com
 04:57:28 blocked by wc-blacklist star.c10r.facebook.com
 04:57:43 blocked by wc-blacklist star.c10r.facebook.com
 04:57:58 blocked by wc-blacklist star.c10r.facebook.com
 04:58:13 blocked by wc-blacklist star.c10r.facebook.com

Looks like blocking this FB domain may be the issue.

Temporarily whitelist it and try again.