Skynet Skynet filter list issue - [*] List Content Error Detected - Stopping Banmalware

[Marcus Yansen]

The fact that my ip address is in red, is that indicative of a problem?

 

[Marcus Yansen]

UPDATE: It started working now, but I didn't do anything.... I did a couple of reboots after, did many reboots today in general. I am not sure why it started working now, are there any clues in system logs etc? The last thing I did was having uninstalled entware - I had installed entware based on recommendation here by helpful @Viktor Jaep that installation of entware may help my issue, but it had not. So I Decided to uninstall it. Then I randomly did a test, and it seems to be working right now...:

Downloading filter.list | [0s]
Refreshing Whitelists | [4s]
Consolidating Blacklist | [0s]
Filtering IPv4 Addresses | [0s]
Filtering IPv4 Ranges | [0s]
Applying New Blacklist | [0s]
Refreshing AiProtect Bans | [1s]
Saving Changes | [0s]

​

 

[Marcus Yansen]

Second update:

So I tried changing the list to this one, and issue recurred: https://raw.githubusercontent.com/jumpsmm7/GeneratedAdblock/master/filter.list

same error again

Third update:
A reboot or two seems to somehow fix this issue. I am completely clueless as to why. Before it didn't though I rebooted a few times and it didn't resolve the issue, but now a reboot seems to fix the issue, specially after i change filterlist url, then it fails to update the filterlist, but once i do a reboot it works.

 

[Viktor Jaep]

Second update:

So I tried changing the list to this one, and issue recurred: https://raw.githubusercontent.com/jumpsmm7/GeneratedAdblock/master/filter.list

same error again

Third update:
A reboot or two seems to somehow fix this issue. I am completely clueless as to why. Before it didn't though I rebooted a few times and it didn't resolve the issue, but now a reboot seems to fix the issue, specially after i change filterlist url, then it fails to update the filterlist, but once i do a reboot it works.

Reboots shouldn't be the fix when it works normally for everyone else. Got to be something going on, but glad things "seem" to be working.

 

[Marcus Yansen]

Yes, after updating to beta 1 from the alpha, it's failing to work again. Even after several reboots. Eventually I'll figure it out I guess. Maybe I will need to do a hard reset or something?

 

[Ripshod]

That must be one small list if it's only taking 5 seconds to update altogether. In fact, it takes 0 seconds to download, 4 seconds to refresh the whitelisting, and 0 seconds to refresh the blacklist. Something must be wrong just there.

 

[Marcus Yansen]

I am so sorry I forgot to say it, but I do have the ctrld script installed as well...I didn't consider it as part of the amtm package so it didn't cross my mind that I should say it.

 

[Marcus Yansen]

Unfortunately after a hard reset, and re-formatting my disk as well and re-installing everything the Skynet issue remains.

 

[Marcus Yansen]

I believe I Figured out the culprit - it's the ctrld dns - when I switch to a dns like google the update seems to be successful. I will do several follow up tests now.

UPDATE: Yes, the issue is controld dns server, it's blocking something - can anyone provide any ideas on what routes this update process goes through? I am going to look at my controld daemon where it will show what is being blocked, but doing that has not always helped me figure these issues out.

Here is my output now, I did several tests everything is working correctly:

Custom Filter Detected: https://raw.githubusercontent.com/jumpsmm7/GeneratedAdblock/master/filter.list
Downloading filter.list | [0s]
Refreshing Whitelists | [3s]
Consolidating Blacklist | [17s]
Filtering IPv4 Addresses | [4s]
Filtering IPv4 Ranges | [2s]
Applying New Blacklist | [6s]
Refreshing AiProtect Bans | [1s]
Saving Changes | [2s]

Update 2:
Still working, However, the weird thing is that even after turning controld is back on and verifying that my internet is using controld using this command in cmd: nslookup verify.controld.com
The lists are still updating fine...I checked my ctrld logs and it is only blocking these right now:

dns.msftncsi.com AND rgom10-asus-en.url.trendmicro.com (which is telemetry from the trendmicro for ai protect)

The only other thing I did that was different is that I set my WAN settings in router to use google dns now - whereas before I had also set that to controld - However, even setting it to google it will still use controld as I have verified - that's what the ctrld script does it overrides the router. I mean until I had turn off controld, ran the list update in skynet, it wouldn't work. But then I turned on controld and it's still working. So I doubt it has anything to do with the manual WAN setting I have to put in my router as I am using static. and not dynamic. So Still a bit clueless as to why it is working now. Here is another output from just now, I will keep testing these days and update the thread accordingly if anything changes. To stop the ctrld server I just typed ctrld stop when I ssh into the router, what that does is do a 'Quick stop service and remove DNS from interface'; i then verified that my connection was using google, and then i tested and that made things work, but as I said, after I turned it back on, updating the list is still working.

Custom Filter Detected: https://raw.githubusercontent.com/jumpsmm7/GeneratedAdblock/master/filter.list
Downloading filter.list | [0s]
Refreshing Whitelists | [5s]
Consolidating Blacklist | [17s]
Filtering IPv4 Addresses | [6s]
Filtering IPv4 Ranges | [1s]
Applying New Blacklist | [6s]
Refreshing AiProtect Bans | [1s]
Saving Changes | [2s]
[#] 360108 IPs (-122) -- 21285 Ranges Banned (+0) || 175 Inbound -- 0 Outbound Connections Blocked! [banmalware] [46s]

 

[Viktor Jaep]

What in the world is CtrlD?! Not sure if I've ever heard of anyone ever using this before... I'll need to dive into the search to learn more I guess.

 

[SomeWhereOverTheRainBow]

What in the world is CtrlD?! Not sure if I've ever heard of anyone ever using this before... I'll need to dive into the search to learn more I guess.

Here you go big guy - https://controld.com/ . It basically put nextdns out of business. JK they are still around.

 

[Viktor Jaep]

Here you go big guy - https://controld.com/ . It basically put nextdns out of business. JK they are still around.

Ah gotcha. Seems a bit like OpenDNS/Umbrella of sorts after briefly looking at it... Meh. Don't need more complications. LOL

 

[Marcus Yansen]

@Viktor Jaep

They are not bad I guess...I attached a few screenshots of a profile I made, and you can see native and 3rd party filters... you can also block or redirect popular services to other countries depending on your plan with them..the block works on regular paid plan and redirect i think u need the next plan. But I think the main complaint about them I've seen is speeds if you don't live close to ctrld dns servers....but I don't know maybe they've improved on that or maybe that's not much of an issue anymore, really have no idea. I don't mean to be advertising for them at all, just thought I paste these since you weren't aware of them. For me I mainly just use them for the filters as i guess many others do, the second screenshot (3rd party filters) and last screenshot, native filters

 

[SomeWhereOverTheRainBow]

@Viktor Jaep

They are not bad I guess...I attached a few screenshots of a profile I made, and you can see native and 3rd party filters... you can also block or redirect popular services to other countries depending on your plan with them..the block works on regular paid plan and redirect i think u need the next plan. But I think the main complaint about them I've seen is speeds if you don't live close to ctrld dns servers....but I don't know maybe they've improved on that or maybe that's not much of an issue anymore, really have no idea. I don't mean to be advertising for them at all, just thought I paste these since you weren't aware of them. For me I mainly just use them for the filters as i guess many others do, the second screenshot (3rd party filters) and last screenshot, native filters

@Viktor Jaep I can see a CtrlDMon on the horizon.

Ah gotcha. Seems a bit like OpenDNS/Umbrella of sorts after briefly looking at it... Meh. Don't need more complications. LOL

But don't let me steal your thunder.

 

[Viktor Jaep]

@Viktor Jaep I can see a CtrlDMon on the horizon.

No no! Not having that! LOL

 

[SomeWhereOverTheRainBow]

@Viktor Jaep who knows, VPN-MON-R3 W/CtrlD integration.

 

[Viktor Jaep]

@Viktor Jaep who knows, VPN-MON-R3 W/CtrlD integration.

Let's please not even consider this... LOL

 

[New2This]

 

[bluzfanmr1]

I've been using ControlD almost since they started and have been happy. I believe their main tech has been on this forum before and is always helpful, be it here or on their own forum.

 

[Tech9]

and is always helpful

The founder, actually. @yegor

Yegor Sak - Control D Blog

controld.com