scribe/uiscribe: May be something, maybe not - 102.5 alpha and syslog-ng

[Ripshod]

I'm only posting this in case the current alpha makes it to release.
syslog-ng is failing to load/run. Symptoms include the sidebar not loading on the System Log>General tab, only the System Messages visible, configurations in /opt/etc/syslog-ng.d not loading. Feels like a stall-out.
Everything in cli looks fine:

 Please select an option: s

      checking syslog-ng daemon ... alive.
    syslog.log default location ... /jffs/syslog.log
  ... & agrees with config file ... okay!

 checking system for necessary scribe hooks ...

          checking S01syslog-ng ... present.
         checking service-event ... present.
            checking post-mount ... present.
               checking unmount ... present.
    checking logrotate cron job ... present.
       checking directory links ... present.

 checking syslog-ng configuration ...

   syslog-ng.conf version check ... in sync. (4.7)
    syslog-ng.conf syntax check ... okay!

          scribe installed version: v3.2_1 (master)
             scribe GitHub version: v3.2_1 (master)
                    scribe is up to date!

 Please select an option: rl
 reloading syslog-ng.conf ... Config reload successful

 Restarting uiScribe ...Mounting WebUI page for uiScribe

Mounted uiScribe WebUI page as Main_LogStatus_Content.asp

 Press [Enter] to continue:

Re-installing doesn't fix.

 

[Martinski]

You could try downloading and installing the latest Scribe v3.2.2 production version from the AMTM-OSR repository:

curl -LSs --retry 4 --retry-delay 5 --retry-connrefused \
https://raw.githubusercontent.com/AMTM-OSR/scribe/master/scribe.sh \
-o /jffs/scripts/scribe && chmod 0755 /jffs/scripts/scribe && /jffs/scripts/scribe install

Both the Scribe and uiScribe production versions are almost ready to be released, but they are not yet integrated with AMTM, so if you install the OSR versions, they would not be recognized by AMTM yet.

If you decide to install them, please let us know the results. For any issues, also provide the full output generated during installation. And for any WebUI page issues, please provide clear screenshots of any errors generated/displayed on the browser console window.

 

[Ripshod]

The OSR scripts have fixed the problem. Well, almost - I had to recreate a filter file (dstentry)

It's a fix, thank you

 

[aex.perez]

I'm only posting this in case the current alpha makes it to release.
syslog-ng is failing to load/run. Symptoms include the sidebar not loading on the System Log>General tab, only the System Messages visible, configurations in /opt/etc/syslog-ng.d not loading. Feels like a stall-out.
Everything in cli looks fine:

 Please select an option: s

      checking syslog-ng daemon ... alive.
    syslog.log default location ... /jffs/syslog.log
  ... & agrees with config file ... okay!

 checking system for necessary scribe hooks ...

          checking S01syslog-ng ... present.
         checking service-event ... present.
            checking post-mount ... present.
               checking unmount ... present.
    checking logrotate cron job ... present.
       checking directory links ... present.

 checking syslog-ng configuration ...

   syslog-ng.conf version check ... in sync. (4.7)
    syslog-ng.conf syntax check ... okay!

          scribe installed version: v3.2_1 (master)
             scribe GitHub version: v3.2_1 (master)
                    scribe is up to date!

 Please select an option: rl
 reloading syslog-ng.conf ... Config reload successful

 Restarting uiScribe ...Mounting WebUI page for uiScribe

Mounted uiScribe WebUI page as Main_LogStatus_Content.asp

 Press [Enter] to continue:

Re-installing doesn't fix.

this exact thing just happend to me on 388.9.2 this afternoon. I thought it was the Google update I did earlier today, but then using Firefox I could scroll through all of the sections under the General Tab withoout locking up. Then I thought it was my reliable AX88u USB that went RO (been slowly dying, a another nightmare for another time) and after three HW resets, a BACKUPMON recovery, a new USB stick and putting the router in USB2 mode, finally giving up after working putting Humpty Dumpty together again for the last three days

One of those things where you begin to doubt yourself. Glad to know I'm not the only one.
As the new releases are close, I'll wait for them before trying again.

UPDATE: Spoke too soon. added a filter I had built that was working before, selected "Show All" in uiScribe 1.47 and under Chrome Version 138.0.7204.50 (Official Build) (64-bit) on Win11, after a few seconds to scroll to the bottom, it hang, with the browser coming back with Aw Snap! and the page not resonsive. Working under Firefox 140.0.2 (64-bit) on the same Win11, but it does take a second scrolling halfway to the bottom to build the page , but then proceeds normally.

So while scribe 3.2.2 fixed the syslog pausing, I think my issue with uiScribe might be Chrome and Edge Version 138.0.3351.55 (Official build) (64-bit) is failed in the same place and same way, as its trying to build the page, but after a few minutes, after it populates Edge then works like Firefox albeit slow and jerky.

Took a screen shot of it, thinking it might have to do with the number of objects as it started after I added the one filter I had built.

Will adjust the number of objects to find the break point, assuming its this and not something else (the purple check boxes are a result of the Chrome upgrade, they didn't use to be purple)

All three browsers fail the same way and in the same place, though the recover very differently, taking one of the filter outs, allows Chrome to fail like the other two, and run slow and jerky, when you "Show All", the working as an log update is made/received (slow/jerky) but moment later unesponsive again, can't even scroll. Hide all, and expanding the System Log only and everything works.

A little later, will try enabling all filters and an expanding additional pages one by one, to try and see where it's breaking.
Thanks for tackling these @Martinski

UPDATE: "A few moments later" , when you select "Show All", even with one additional other thant the Systen Log, but you can expand each individually, but I couldn't get past 8 of them without the page becone unresponsive and slo and jerky for a few seconds after any Log update is received...

 

[aex.perez]

The OSR scripts have fixed the problem. Well, almost - I had to recreate a filter file (dstentry)

It's a fix, thank you

Got curious, impatient and anxious. It's paid off.
Working flawlessly now!

 

[aex.perez]

this exact thing just happend to me on 388.9.2 this afternoon. I thought it was the Google update I did earlier today, but then using Firefox I could scroll through all of the sections under the General Tab withoout locking up. Then I thought it was my reliable AX88u USB that went RO (been slowly dying, a another nightmare for another time) and after three HW resets, a BACKUPMON recovery, a new USB stick and putting the router in USB2 mode, finally giving up after working putting Humpty Dumpty together again for the last three days

One of those things where you begin to doubt yourself. Glad to know I'm not the only one.
As the new releases are close, I'll wait for them before trying again.

UPDATE: Spoke too soon. added a filter I had built that was working before, selected "Show All" in uiScribe 1.47 and under Chrome Version 138.0.7204.50 (Official Build) (64-bit) on Win11, after a few seconds to scroll to the bottom, it hang, with the browser coming back with Aw Snap! and the page not resonsive. Working under Firefox 140.0.2 (64-bit) on the same Win11, but it does take a second scrolling halfway to the bottom to build the page , but then proceeds normally.

So while scribe 3.2.2 fixed the syslog pausing, I think my issue with uiScribe might be Chrome and Edge Version 138.0.3351.55 (Official build) (64-bit) is failed in the same place and same way, as its trying to build the page, but after a few minutes, after it populates Edge then works like Firefox albeit slow and jerky.

Took a screen shot of it, thinking it might have to do with the number of objects as it started after I added the one filter I had built.
View attachment 66433

Will adjust the number of objects to find the break point, assuming its this and not something else (the purple check boxes are a result of the Chrome upgrade, they didn't use to be purple)
View attachment 66434

All three browsers fail the same way and in the same place, though the recover very differently, taking one of the filter outs, allows Chrome to fail like the other two, and run slow and jerky, when you "Show All", the working as an log update is made/received (slow/jerky) but moment later unesponsive again, can't even scroll. Hide all, and expanding the System Log only and everything works.

A little later, will try enabling all filters and an expanding additional pages one by one, to try and see where it's breaking.
Thanks for tackling these @Martinski

UPDATE: "A few moments later" , when you select "Show All", even with one additional other thant the Systen Log, but you can expand each individually, but I couldn't get past 8 of them without the page becone unresponsive and slo and jerky for a few seconds after any Log update is received...

UGH! @Martinski Ignore.

I'm an idiot. Nothing like making your own mess and wasting everyone's time trying to justify it's something else

Root Cause: A corrupted log file, from the backup of the USB that , from the filter I created, then on deleting that. Noticing that I wrote over the logrotate.d filter with the filter in syslog-ng.d. Then permissions on logrotate.status were wrong - "Router logrotate: warning: state file /var/lib/logrotate.status is world-readable and thus can be locked from other unprivileged users. Skipping lock acquisition..."

NOW, its all working.