What's new

Skynet Filter Validator v0.7 - Skynet Firewall Filter List IPv4 Integrity Validator

  • SNBForums Code of Conduct

    SNBForums is a community for everyone, no matter what their level of experience.

    Please be tolerant and patient of others, especially newcomers. We are all here to share and learn!

    The rules are simple: Be patient, be nice, be helpful or be gone!

@visortgw

The second test has even better results.


and third test.

1678224473728.png


This definitely shows the download aspect is the biggest factor.
 
Who's ready for v0.6 with some awesome performance stats... as @SomeWhereOverTheRainBow and I found out, the biggest factor that affects processing time is the amount of time it takes to download the list from the server... probably due to internet weather, or current server load. Enjoy! ;)

Some sweet sweet stats courtesy of @SomeWhereOverTheRainBow!
1678233534114.png
 
Hello @Viktor Jaep ....I appreciate the script and I've yet to try it! I did have a question...I only use the default list (settings) within Diversion (lite) and Skynet. Just curious if I run this script and notice an invalid IP...what would be the steps to correct this within Skynet and/or Diversion? Or does the only work with custom made list?
 
Last edited:
Hello @Viktor Jaep ....I appreciate the script and I've yet to try it! I did have a question...I only use the default list (settings) within Diversion (lite) and Skynet. Just curious if I run this script and notice an invalid IP...what would be the steps to correct this within Skynet and/or Diversion? Or does the only work with custom made list?
It would be highly unlikely that his list would break, but if it did - you're right - you would be dead in the water until he fixed the list... or, unless you switched over to another list. These are the sources he uses in his list:

Code:
https://iplists.firehol.org/files/alienvault_reputation.ipset
https://iplists.firehol.org/files/bds_atif.ipset
https://iplists.firehol.org/files/cybercrime.ipset
https://iplists.firehol.org/files/dyndns_ponmocup.ipset
https://iplists.firehol.org/files/et_block.netset
https://iplists.firehol.org/files/et_compromised.ipset
https://iplists.firehol.org/files/firehol_level2.netset
https://iplists.firehol.org/files/firehol_level3.netset
https://iplists.firehol.org/files/spamhaus_edrop.netset
https://iplists.firehol.org/files/urlvir.ipset

Oh, and not quite sure about Diversion... I've not dived into figuring out where those lists live. ;)
 
Who's ready for v0.6 with some awesome performance stats... as @SomeWhereOverTheRainBow and I found out, the biggest factor that affects processing time is the amount of time it takes to download the list from the server... probably due to internet weather, or current server load. Enjoy! ;)

Some sweet sweet stats courtesy of @SomeWhereOverTheRainBow!
View attachment 48377

And mine:
Code:
[Valid List Entries]: 33
[Invalid List Entries]: 0
[Total Items Checked]: 329019
[Total Processing Runtime]: 22130 ms or 22.130 sec
 
And mine:
Code:
[Valid List Entries]: 33
[Invalid List Entries]: 0
[Total Items Checked]: 329019
[Total Processing Runtime]: 22130 ms or 22.130 sec
Here is my best run:

Code:
---------------------------------------------
[Valid List Entries]: 40
[Invalid List Entries]: 0
[Total Items Checked]: 544451
[Total Processing Runtime]: 17100 ms or 17.100 sec

@Viktor Jaep

Clocked me.
 
Here is my best run:

Code:
---------------------------------------------
[Valid List Entries]: 40
[Invalid List Entries]: 0
[Total Items Checked]: 544451
[Total Processing Runtime]: 17100 ms or 17.100 sec

@Viktor Jaep

Clocked me.
This was my worst sofar...

1678238614449.png
 
Why download the lists again when they should already be sitting there in /tmp/mnt/<label>/skynet/lists/?
That is assuming they haven't become borked in between load failures. I am sure it is doable if the lists are intact. I imagine we could add an option to check the lists if they are intact. I think the original idea of the script was to check a filter list before attempting to load it. Basically a tool users can use to see if the custom filter list will bork skynet loading process. We wouldn't want to load a filter.list if it is problematic.
 
*looks at pull requests*

While I can appreciate the effort here, is the better solution to not just improve the built-in regex to ignore these edge cases?
 
*looks at pull requests*

While I can appreciate the effort here, is the better solution to not just improve the built-in regex to ignore these edge cases?
Pull request submited:

I think I added in all possible places to consider.
 
Last edited:
Just saw a minor update to Skynet...might be a fix maybe?
 

Latest threads

Support SNBForums w/ Amazon

If you'd like to support SNBForums, just use this link and buy anything on Amazon. Thanks!

Sign Up For SNBForums Daily Digest

Get an update of what's new every day delivered to your mailbox. Sign up here!
Top