Skip to content

Log file rotation breaks automatic import

Yesterday the logfiles were rotated by logrotate, and since then lightmeter does not see any new sent mails. Lightmeters logs do not contain any "Inserted 1 rows in a transaction" lines since yesterday evening.

To make matters worse, restarting the service does not help! It probably stores the line number of the old (rotated) log files and applies them to the fresh log files:

Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Importing Postfix logs directory from time 2020-11-30 18:34:16 +0000 UTC
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Lightmeter ControlCenter is running on http://127.0.0.1:10020
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Seeked /var/log/mail.log - &{Offset:4001856 Whence:0}
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Seeked /var/log/mail.warn - &{Offset:842798 Whence:0}
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Finished importing log file: /var/log/mail.log
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Finished importing log file: /var/log/mail.warn
Dec 01 11:13:26 ahso3 lightmeter[28410]: 2020/12/01 11:13:26 Finished importing postfix log directory in: 167.847164ms

Last log line: 2020/11/30 19:34:18

Log file dates:

$ ls -la /var/log/mail*
-rw-r----- 1 root adm        0 Feb  3  2019 /var/log/mail.err
-rw-r----- 1 root adm      765 Feb  3  2019 /var/log/mail.err-20190203
-rw-r----- 1 root adm  3995404 Dec  1 11:09 /var/log/mail.info
-rw-r----- 1 root adm   988111 Nov  8 05:17 /var/log/mail.info-20201108.gz
-rw-r----- 1 root adm  1213402 Nov 16 05:17 /var/log/mail.info-20201116.gz
-rw-r----- 1 root adm  1242497 Nov 22 05:17 /var/log/mail.info-20201122.gz
-rw-r----- 1 root adm 23353078 Nov 30 05:17 /var/log/mail.info-20201130
-rw-r----- 1 root adm  3995404 Dec  1 11:09 /var/log/mail.log
-rw-r----- 1 root adm   988111 Nov  8 05:17 /var/log/mail.log-20201108.gz
-rw-r----- 1 root adm  1213402 Nov 16 05:17 /var/log/mail.log-20201116.gz
-rw-r----- 1 root adm  1242497 Nov 22 05:17 /var/log/mail.log-20201122.gz
-rw-r----- 1 root adm 23353078 Nov 30 05:17 /var/log/mail.log-20201130
-rw-r----- 1 root adm   841353 Dec  1 11:09 /var/log/mail.warn
-rw-r----- 1 root adm   121626 Nov  8 05:17 /var/log/mail.warn-20201108.gz
-rw-r----- 1 root adm   176363 Nov 16 05:17 /var/log/mail.warn-20201116.gz
-rw-r----- 1 root adm   189158 Nov 22 05:17 /var/log/mail.warn-20201122.gz
-rw-r----- 1 root adm  4944172 Nov 30 05:17 /var/log/mail.warn-20201130

logrotate settings:

/var/log/mail.info
/var/log/mail.warn
/var/log/mail.err
/var/log/mail.log
{
        rotate 4
        weekly
        missingok
        notifempty
        compress
        delaycompress
        sharedscripts
        postrotate
                invoke-rc.d rsyslog rotate > /dev/null
        endscript
}

Version number of controlcenter

Version: 1.0.1

Postfix version

Version: 3.1.15

Sqlite version Version:

Filename: /var/lib/lightmeter/auth.db
database page size:  4096
write format:        2
read format:         2
reserved bytes:      0
file change counter: 2
database page count: 5
freelist page count: 0
schema cookie:       3
schema format:       4
default cache size:  0
autovacuum top root: 0
incremental vacuum:  0
text encoding:       1 (utf8)
user version:        0
application id:      0
software version:    3033000
number of tables:    4
number of indexes:   0
number of triggers:  0
number of views:     0
schema size:         403
Filename: /var/lib/lightmeter/insights.db
database page size:  4096
write format:        2
read format:         2
reserved bytes:      0
file change counter: 2
database page count: 9
freelist page count: 0
schema cookie:       7
schema format:       4
default cache size:  0
autovacuum top root: 0
incremental vacuum:  0
text encoding:       1 (utf8)
user version:        0
application id:      0
software version:    3033000
number of tables:    4
number of indexes:   4
number of triggers:  0
number of views:     0
schema size:         760
Filename: /var/lib/lightmeter/logs.db
database page size:  4096
write format:        2
read format:         2
reserved bytes:      0
file change counter: 1
database page count: 1
freelist page count: 0
schema cookie:       0
schema format:       0
default cache size:  0
autovacuum top root: 0
incremental vacuum:  0
text encoding:       0
user version:        0
application id:      0
software version:    3033000
number of tables:    3
number of indexes:   1
number of triggers:  0
number of views:     0
schema size:         888
Filename: /var/lib/lightmeter/master.db
database page size:  4096
write format:        2
read format:         2
reserved bytes:      0
file change counter: 2
database page count: 4
freelist page count: 0
schema cookie:       2
schema format:       4
default cache size:  0
autovacuum top root: 0
incremental vacuum:  0
text encoding:       1 (utf8)
user version:        0
application id:      0
software version:    3033000
number of tables:    3
number of indexes:   0
number of triggers:  0
number of views:     0
schema size:         334

Attach logs

lightmeter-logrotate.log

Which Operating System and version are you using?

OS: Debian Linux

Version: 9

Edited by cweiske