Adding my voice for the feature. I use my mobile to access the GUI a lot and I’ve ended up stuck many many times. Would love the ability to disable the graph zoom. (I can’t be the only one using a mobile to access the page can I?)
Logs already write to /opt/var/log if using Diversion - which is on the USB storage. My current sqlite experimental approach also writes to /opt/share, ergo USB.
Logs already write to /opt/var/log if using Diversion - which is on the USB storage. My current sqlite experimental approach also writes to /opt/share, ergo USB.
Timestamp is needed, e.g. show me number of queries over last 24 hours, last 7 days. It is trivial to delete records older than 7 days using a separate cron job, perhaps hourly. This is a change in that the time period is a rolling 7 day window, for example.
Size isn't so much of a problem, since Skynet recommends at least 1GB in swap - most USB storage devices are likely 4GB and above
Filesize doesn't seem too bad, this is after a weeks usage with 20ish devices:My first ideas was if dnsmasq was writting logs to /tmp (tempfs in memory) and you tail the log and place into SQLite (which can be on USB, as it should collaspe smaller), then if you flush the logs hourly it will really reduce disk wear.
That being said, as a user you would need to turn off diversion's weekly stats email, since the dnsmasq logs would not survive long enough for that feature, but your sqlite would be able to reproduce all you need for stats.
You need the date perhaps, but not the full timestamp (minute/hour/seconds), so perhaps collapse this down to:
<day><requesting IP><requested site><response><count>
The DB will greatly slow down in growth, and your stats are still useful.
Either way, even if you don't think this make sense, thank you. Would you perhaps have add a feature to flush the logs regularly? If diversion has that feature I haven't found it. Once this is in SQLite it is much better than the raw logs
Everything in /tmp would be lost after a reboot, expected or not. This is not an option.
Agree, not suggesting to keep the SQLite DB in tmp. Just the dnsmasq logs. Once they are tailed and redirected into SQLite the log files are not really needed anymore. SQLite would be the system of record.
tail feeding via awk script to get just the log lines that are needed, namely query + reply (i.e. blocked or not) for nowLooking forward to see the SQLite version.
Can you share any insights on how you are tailing the file into SQLite? Have some thoughts
i considered that, but it was an extra layer of complexity (and i couldn't find how to chop up the log message into the relevant fields)
#!/bin/sh
#=======================================
# Grep dnsmasq.log for some guest network traffic history
# Writes output to stdout and a log file
# Set log-queries=extra option ON in Diversion settings
# Run from cron if desired and comment out the first command and remove the comment
# from the second command in order to skip sending the output to stdout.
# set to your guest network:
GUEST_NET="192.168.30"
# set to the path of your desired log file
LOG="/tmp/mnt/archive/logs/guest_history.log"
TIMESTAMP=`date -R`
echo "" >>$LOG
echo "===================== ${TIMESTAMP} ====================" >>$LOG
echo "" >>$LOG
# Commands (see note in comments at top):
grep "$GUEST_NET.[0-9][0-9]\$" /opt/var/log/dnsmasq.log | awk '{print $1,$2,$3,$5,$6,$7,$8}' | tee -a $LOG
#grep "$GUEST_NET.[0-9][0-9]\$" /opt/var/log/dnsmasq.log | awk '{print $1,$2,$3,$5,$6,$7,$8}' >>$LOGIf i build in the sqlite logging to uiDivStats (albeit only to start storing dns data in sqlite), would you be interested in testing/making sure it is stable?
Open Diversion, then d, 7 should be what you want.
The size of dnsmasq.log* will cause this. A new and improved sqlite version is being worked on
Welcome To SNBForums
SNBForums is a community for anyone who wants to learn about or discuss the latest in wireless routers, network storage and the ins and outs of building and maintaining a small network.
If you'd like to post a question, simply register and have at it!
While you're at it, please check out SmallNetBuilder for product reviews and our famous Router Charts, Ranker and plenty more!
