Log file rotation breaks automatic import
Yesterday the logfiles were rotated by logrotate, and since then lightmeter does not see any new sent mails. Lightmeters logs do not contain any "Inserted 1 rows in a transaction" lines since yesterday evening.
To make matters worse, restarting the service does not help! It probably stores the line number of the old (rotated) log files and applies them to the fresh log files:
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Importing Postfix logs directory from time 2020-11-30 18:34:16 +0000 UTC
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Lightmeter ControlCenter is running on http://127.0.0.1:10020
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Seeked /var/log/mail.log - &{Offset:4001856 Whence:0}
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Seeked /var/log/mail.warn - &{Offset:842798 Whence:0}
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Finished importing log file: /var/log/mail.log
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Finished importing log file: /var/log/mail.warn
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Finished importing postfix log directory in: 167.847164ms
Last log line: 2020/11/30 19:34:18
Log file dates:
$ ls -la /var/log/mail*
-rw-r----- 1 root adm 0 Feb 3 2019 /var/log/mail.err
-rw-r----- 1 root adm 765 Feb 3 2019 /var/log/mail.err-20190203
-rw-r----- 1 root adm 3995404 Dec 1 11:09 /var/log/mail.info
-rw-r----- 1 root adm 988111 Nov 8 05:17 /var/log/mail.info-20201108.gz
-rw-r----- 1 root adm 1213402 Nov 16 05:17 /var/log/mail.info-20201116.gz
-rw-r----- 1 root adm 1242497 Nov 22 05:17 /var/log/mail.info-20201122.gz
-rw-r----- 1 root adm 23353078 Nov 30 05:17 /var/log/mail.info-20201130
-rw-r----- 1 root adm 3995404 Dec 1 11:09 /var/log/mail.log
-rw-r----- 1 root adm 988111 Nov 8 05:17 /var/log/mail.log-20201108.gz
-rw-r----- 1 root adm 1213402 Nov 16 05:17 /var/log/mail.log-20201116.gz
-rw-r----- 1 root adm 1242497 Nov 22 05:17 /var/log/mail.log-20201122.gz
-rw-r----- 1 root adm 23353078 Nov 30 05:17 /var/log/mail.log-20201130
-rw-r----- 1 root adm 841353 Dec 1 11:09 /var/log/mail.warn
-rw-r----- 1 root adm 121626 Nov 8 05:17 /var/log/mail.warn-20201108.gz
-rw-r----- 1 root adm 176363 Nov 16 05:17 /var/log/mail.warn-20201116.gz
-rw-r----- 1 root adm 189158 Nov 22 05:17 /var/log/mail.warn-20201122.gz
-rw-r----- 1 root adm 4944172 Nov 30 05:17 /var/log/mail.warn-20201130
logrotate settings:
/var/log/mail.info
/var/log/mail.warn
/var/log/mail.err
/var/log/mail.log
{
rotate 4
weekly
missingok
notifempty
compress
delaycompress
sharedscripts
postrotate
invoke-rc.d rsyslog rotate > /dev/null
endscript
}
Version number of controlcenter
Version: 1.0.1
Postfix version
Version: 3.1.15
Sqlite version Version:
Filename: /var/lib/lightmeter/auth.db
database page size: 4096
write format: 2
read format: 2
reserved bytes: 0
file change counter: 2
database page count: 5
freelist page count: 0
schema cookie: 3
schema format: 4
default cache size: 0
autovacuum top root: 0
incremental vacuum: 0
text encoding: 1 (utf8)
user version: 0
application id: 0
software version: 3033000
number of tables: 4
number of indexes: 0
number of triggers: 0
number of views: 0
schema size: 403
Filename: /var/lib/lightmeter/insights.db
database page size: 4096
write format: 2
read format: 2
reserved bytes: 0
file change counter: 2
database page count: 9
freelist page count: 0
schema cookie: 7
schema format: 4
default cache size: 0
autovacuum top root: 0
incremental vacuum: 0
text encoding: 1 (utf8)
user version: 0
application id: 0
software version: 3033000
number of tables: 4
number of indexes: 4
number of triggers: 0
number of views: 0
schema size: 760
Filename: /var/lib/lightmeter/logs.db
database page size: 4096
write format: 2
read format: 2
reserved bytes: 0
file change counter: 1
database page count: 1
freelist page count: 0
schema cookie: 0
schema format: 0
default cache size: 0
autovacuum top root: 0
incremental vacuum: 0
text encoding: 0
user version: 0
application id: 0
software version: 3033000
number of tables: 3
number of indexes: 1
number of triggers: 0
number of views: 0
schema size: 888
Filename: /var/lib/lightmeter/master.db
database page size: 4096
write format: 2
read format: 2
reserved bytes: 0
file change counter: 2
database page count: 4
freelist page count: 0
schema cookie: 2
schema format: 4
default cache size: 0
autovacuum top root: 0
incremental vacuum: 0
text encoding: 1 (utf8)
user version: 0
application id: 0
software version: 3033000
number of tables: 3
number of indexes: 0
number of triggers: 0
number of views: 0
schema size: 334
Attach logs
Which Operating System and version are you using?
OS: Debian Linux
Version: 9
Edited by cweiske