Menu
What's new
By:
Filters Better Search

uiDivStats uiDivStats - WebUI for Diversion statistics

  • SNBForums Code of Conduct

    SNBForums is a community for everyone, no matter what their level of experience.

    Please be tolerant and patient of others, especially newcomers. We are all here to share and learn!

    The rules are simple: Be patient, be nice, be helpful or be gone!

pattiri said:
Code: 
Choose an option:    2

awk: cmd. line:1: Division by zero
awk: cmd. line:1: Division by zero
awk: cmd. line:1: Division by zero
uiDivStats: Stats updated successfully

Press enter to continue...

I've just disabled extra query logging for dnsmasq and here is my current dnsmasq settings if it helps;


Code: 
Dnsmasq settings:

 See the Dnsmasq man page what these options do:
 http://www.thekelleys.org.uk/dnsmasq/docs/dnsmasq-man.html

 1. Disable Dnsmasq settings
 2. log-async         20
 3. cache-size        2500
 4. bogus-priv        on
 5. domain-needed     on
 6. log-queries=extra
Click to expand...
taildns seemed to be using the correct awk script for you. What do you get if you run:
Code: 
sqlite3 /opt/share/uiDivStats.d/dnsqueries.db
.tables
select * from dnsqueries;
 
Dan Ljungberg said:
Code: 
dana@RT-AC2900-72D8:/tmp/home/root# cat /etc/dnsmasq.conf | grep log
log-async
log-queries=extra
log-facility=/opt/var/log/dnsmasq.log
dana@RT-AC2900-72D8:/tmp/home/root#
thanks!
Click to expand...
Can you try restarting taildns?
Code: 
/opt/etc/init.d/S90taildns stop
sleep 5
/opt/etc/init.d/S90taildns start
ps | grep taildns
 
Jack Yaz said:
Code:
sqlite /opt/share/uiDivStats.d/dnsqueries.db
.tables
select * from dnsqueries;
Click to expand...

I guess I run them in wrong place? :D

Code: 
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# .tables
-sh: .tables: not found
admin@FaTiii:/tmp/home/root# select * from dnsqueries;
-sh: select: not found
admin@FaTiii:/tmp/home/root#
 
pattiri said:
I guess I run them in wrong place? :D

Code: 
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# sqlite /opt/share/uiDivStats.d/dnsqueries.db
-sh: sqlite: not found
admin@FaTiii:/tmp/home/root# .tables
-sh: .tables: not found
admin@FaTiii:/tmp/home/root# select * from dnsqueries;
-sh: select: not found
admin@FaTiii:/tmp/home/root#
Click to expand...
sorry, it should be sqlite3
 
Jack Yaz said:
sorry, it should be sqlite3
Click to expand...

No problem :)

Code: 
admin@FaTiii:/tmp/home/root# sqlite3 /opt/share/uiDivStats.d/dnsqueries.db
SQLite version 3.31.1 2020-01-27 19:55:54
Enter ".help" for usage hints.
sqlite> .tables
dnsqueries         dnsqueriesmonthly  dnsqueriesweekly
sqlite> select * from dnsqueries;
sqlite>
 
Jack Yaz said:
OK so it looks like you have extra query logging for dnsmasq enabled, but taildns is using the standard awk script. Can you send the output of:
Code: 
cat /etc/dnsmasq.conf | grep log
please?
Click to expand...

Code: 
dana@RT-AC2900-72D8:/tmp/home/root# cat /etc/dnsmasq.conf | grep log
log-async
log-queries=extra
log-facility=/opt/var/log/dnsmasq.log
dana@RT-AC2900-72D8:/tmp/home/root#
than
Jack Yaz said:
Can you try restarting taildns?
Code: 
/opt/etc/init.d/S90taildns stop
sleep 5
/opt/etc/init.d/S90taildns start
ps | grep taildns
Click to expand...

Code: 
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns stop
 Checking taildns...              alive.
 Shutting down taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# sleep 5
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns start
 Starting taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# ps | grep taildns
21966 dana      3368 S    {taildns} /bin/sh /opt/bin/taildns
21969 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
21974 dana      3368 S    {dnsmasqtotalext} /usr/bin/awk -f /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotalextra.awk
21975 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
22029 dana      5432 S    grep taildns
dana@RT-AC2900-72D8:/tmp/home/root#
 
pattiri said:
No problem :)

Code: 
admin@FaTiii:/tmp/home/root# sqlite3 /opt/share/uiDivStats.d/dnsqueries.db
SQLite version 3.31.1 2020-01-27 19:55:54
Enter ".help" for usage hints.
sqlite> .tables
dnsqueries         dnsqueriesmonthly  dnsqueriesweekly
sqlite> select * from dnsqueries;
sqlite>
Click to expand...
Well that confirms the data isn't making it into the database for some reason. Please try restarting taildns (using the steps I posted earlier) and then run:
Code: 
tail -F /opt/var/log/dnsmasq.log /opt/var/log/dnsmasq.log3 | /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
assuming you still have extra query logging turned off
 
Dan Ljungberg said:
Code: 
dana@RT-AC2900-72D8:/tmp/home/root# cat /etc/dnsmasq.conf | grep log
log-async
log-queries=extra
log-facility=/opt/var/log/dnsmasq.log
dana@RT-AC2900-72D8:/tmp/home/root#
than


Code: 
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns stop
 Checking taildns...              alive.
 Shutting down taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# sleep 5
dana@RT-AC2900-72D8:/tmp/home/root# /opt/etc/init.d/S90taildns start
 Starting taildns...              done.
dana@RT-AC2900-72D8:/tmp/home/root# ps | grep taildns
21966 dana      3368 S    {taildns} /bin/sh /opt/bin/taildns
21969 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
21974 dana      3368 S    {dnsmasqtotalext} /usr/bin/awk -f /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotalextra.awk
21975 dana      3368 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
22029 dana      5432 S    grep taildns
dana@RT-AC2900-72D8:/tmp/home/root#
Click to expand...
OK so taildns is using the right awk script now. Hopefully you'll see your database file growing/modified:
Code: 
ls -lah /opt/share/uiDivStats.d/dnsqueries.db
 
Jack Yaz said:
Well that confirms the data isn't making it into the database for some reason. Please try restarting taildns (using the steps I posted earlier) and then run:
Code: 
tail -F /opt/var/log/dnsmasq.log /opt/var/log/dnsmasq.log3 | /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
assuming you still have extra query logging turned off
Click to expand...

here;

Code: 
admin@FaTiii:/tmp/home/root# /opt/etc/init.d/S90taildns stop
 Checking taildns...              alive.
 Shutting down taildns...              done.
admin@FaTiii:/tmp/home/root# sleep 5
admin@FaTiii:/tmp/home/root# /opt/etc/init.d/S90taildns start
 Starting taildns...              done.
admin@FaTiii:/tmp/home/root# ps | grep taildns
28269 admin     1420 S    {taildns} /bin/sh /opt/bin/taildns
28272 admin     1420 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
28278 admin     1444 S    {dnsmasqtotal.aw} /usr/bin/awk -f /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
28279 admin     1424 S    {taildnstotal} /bin/sh /jffs/addons/uiDivStats.d/taildns.d/taildnstotal
28335 admin     4656 S    grep taildns
admin@FaTiii:/tmp/home/root# tail -F /opt/var/log/dnsmasq.log /opt/var/log/dnsmasq.log3 | /jffs/addons/uiDivStats.d/taildns.d/dnsmasqtotal.awk
tail: can't open '/opt/var/log/dnsmasq.log3': No such file or directory
1591453572,172.24.5.2,spclient.wg.spotify.com,A,allowed
1591453618,172.24.5.8,chat.cdn.whatsapp.net,A,allowed
1591453648,172.24.5.15,mapi.speedtest.net,A,allowed
1591453648,127.0.1.1,speedtest.net,dnssec-DS,allowed
1591453649,172.24.5.2,mix.com,A,allowed
1591453649,172.24.5.2,mix.com,A,allowed
1591453649,127.0.1.1,mix.com,dnssec-DS,allowed
1591453649,172.24.5.2,mix.com,A,allowed
1591453649,172.24.5.2,mix.com,AAAA,allowed
1591453649,172.24.5.2,us.hola.com,A,allowed
1591453650,127.0.1.1,hola.com,dnssec-DS,allowed
1591453650,172.24.5.2,e13750.a.akamaiedge.net,A,allowed
1591453650,172.24.5.2,e13750.a.akamaiedge.net,AAAA,allowed
1591453650,172.24.5.2,tagger.opecloud.com,A,blocked (blocking list)
1591453650,172.24.5.2,amplifypixel.outbrain.com,A,blocked (blocking list)
1591453650,172.24.5.2,tagger.opecloud.com,A,blocked (blocking list)

I can see new logs as I browse internet. so I've chosen option 2 and here we have the happy result :) Thank you very much :)

Screenshot_1.jpg
 
uninstalled existing version, and then installed new version.
install stuck at "Creating database table indexes..."
 
Jack Yaz said:
OK so taildns is using the right awk script now. Hopefully you'll see your database file growing/modified:
Code: 
ls -lah /opt/share/uiDivStats.d/dnsqueries.db
Click to expand...
Jack Yaz said:
OK so taildns is using the right awk script now. Hopefully you'll see your database file growing/modified:
Code: 
ls -lah /opt/share/uiDivStats.d/dnsqueries.db
Click to expand...

Still no growing database file and no stats :confused:
Is it easier if I uninstall and reinstall, or are you interested in troubleshooting more?
 
fresh new install:

cromo@RT-AX88U-8158:/tmp/home/root# /usr/sbin/curl --retry 3 "https://raw.githubusercontent.com/jackyaz/uiDivStats/maste
r/uiDivStats.sh" -o "/jffs/scripts/uiDivStats" && chmod 0755 /jffs/scripts/uiDivStats && /jffs/scripts/uiDivStats instal
l
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 43273 100 43273 0 0 355k 0 --:--:-- --:--:-- --:--:-- 449k
uiDivStats: Welcome to uiDivStats v2.0.0, a script by JackYaz

uiDivStats: Checking your router meets the requirements for uiDivStats

Downloading http://bin.entware.net/aarch64-k3.10/Packages.gz
Updated list of available packages in /opt/var/opkg-lists/entware
Package grep (3.4-1) installed in root is up to date.
Package sqlite3-cli (3310100-1) installed in root is up to date.
Package procps-ng-pkill (3.3.15-4) installed in root is up to date.
uiDivStats: New version of uidivstats_www.asp downloaded

uiDivStats: Mounting uiDivStats WebUI page as user3.asp

uiDivStats: New version of taildns.tar.gz downloaded

Downloading http://bin.entware.net/aarch64-k3.10/Packages.gz
Updated list of available packages in /opt/var/opkg-lists/entware
Package grep (3.4-1) installed in root is up to date.
Package sqlite3-cli (3310100-1) installed in root is up to date.
Package procps-ng-pkill (3.3.15-4) installed in root is up to date.
uiDivStats: Creating database table and enabling write-ahead logging...

uiDivStats: Creating database table indexes...

Error: near line 1: index idx_dns_domains already exists
Error: near line 1: index idx_dns_time already exists
Error: near line 1: index idx_dns_clients already exists
uiDivStats: Database ready, starting services...

uiDivStats: Starting first run of stat generation...

uiDivStats: Stats updated successfully



After this, the UI page is missing. even after a reboot
 
Last edited:
Dan Ljungberg said:
did an


Thanks for quick and good response with my troubleshooting.
I tested and uninstalled and deleted db from CLI, restarted the router and then reinstalled from CLI.
But still no stats :mad:

I'm also stumped :confused:
Click to expand...
at this stage, would you be up for a screensharing session using Teamviewer or VNC or something?
 
@Jack Yaz Might it be that taildns is starting before Diversion modifies /etc/dnsmasq.conf and therefore misses the log queries extra configuration?
 
RT-AX88U on RT-AX88U_384.18_alpha1-g6368a955e8 firmware.

I had the previous uiDivStats version running before but uninstalled it for other troubleshooting issues (and waited for v2.00 to become available before I re-installed it again).

Just installed v2.00 with router currently 'up' 8 days and 9 hours. No issues, Tab shows in LAN, and everything running normally with no reboot needed (although I will probably do one in an hour or so, as per my 'normal' after any change in the GUI).

Thank you very much @Jack Yaz! Another solid release.
 
This is a great upgrade! A lot of complexity behind the scenes to make it look so cool. :cool:

Noticed this today that when dnssec is enabled there are extra lines in the log that probably want to be filtered out. I had dnssec disabled during beta testing. :oops:

upload_2020-6-6_12-13-43.jpeg


Code: 
Jun  6 12:08:13 dnsmasq[9727]: dnssec-query[DS] asuswrt-merlin.net to 9.9.9.11
Jun  6 12:08:13 dnsmasq[9727]: dnssec-query[DNSKEY] asuswrt-merlin.net to 9.9.9.11
 
You must log in or register to reply here.

Similar threads

314eter
uiDivStats uiDivStats development version compatible with Diversion 5.0
2 3 4
Replies
63
Views
6K
Aziron5
A
Jack Yaz
uiDivStats uiDivStats 3.x
2 3 4
Replies
64
Views
14K
SomeWhereOverTheRainBow
SomeWhereOverTheRainBow
Jack Yaz
YazFi YazFi v4.x - continued
4 5 6
Replies
107
Views
15K
Martinski
M
Jack Yaz
uiDivStats - WebUI for Diversion statistics
Replies
3
Views
2K
Jack Yaz
Jack Yaz
janico82
sbnMerlin 1.2.1 - Network Isolation Tool based on Guest Networks, April 19 2024
2 3 4
Replies
65
Views
5K
visortgw
visortgw
Similar threads
Thread starter Title Forum Replies Date
thelonelycoder uiDivStats uiDivstats 4.0.0 - WebUI Stats for Diversion, April 21, 2024 Asuswrt-Merlin AddOns 27
314eter uiDivStats uiDivStats development version compatible with Diversion 5.0 Asuswrt-Merlin AddOns 63
B uiDivStats Lots of disk writes due to fully re-writing file ./entware/share/uiDivStats.d/csv/SQLQueryLog.htm Asuswrt-Merlin AddOns 0
J Diversion uiDivStats client name only showing as IP address Asuswrt-Merlin AddOns 8
HUNited vnStat WebUI page not found vnStat & connmon Asuswrt-Merlin AddOns 3
Mogsy Skynet Skynet WebUI as scMerlin sitemap Asuswrt-Merlin AddOns 7
M FTP with WebUI Asuswrt-Merlin AddOns 2
R Diversion Diversion and Ubisoft Connect - how to find out what is the problematic block? Asuswrt-Merlin AddOns 5
Philip Bondi Diversion Diversion 5.0 ad blocking sample; very happy with user experience Asuswrt-Merlin AddOns 7
B Diversion Diversion help Asuswrt-Merlin AddOns 14

Similar threads

Latest threads

Sign Up For SNBForums Daily Digest

Get an update of what's new every day delivered to your mailbox. Sign up here!

Members online

Total: 935 (members: 21, guests: 914)
Top