Comments on: Parse Plesk Maillog, Count Emails Per Domain

By: Matt

Matt — Thu, 22 Jan 2009 15:48:56 +0000

Thanks for the bug fix Juan. I’ve posted a version of this script that copies and decompresses the log file into a working copy and then deletes it when it’s done.

You’re right, my first version is pretty bad for larger plesk installations. And I think it gets exponentially worse as the log file size increases.

-Matt

By: Juan C Lopez

Juan C Lopez — Thu, 22 Jan 2009 01:41:06 +0000

Me again I just seen the error in the script
you typed:

do
echo $DOMAIN `zgrep -c -E “(to|from)=.+@$domain” /usr/local/psa/var/log/maillog.processed.1.gz`
done

and sould be:
do
echo $DOMAIN `zgrep -c -E “(to|from)=.+@$DOMAIN” /usr/local/psa/var/log/maillog.processed.1.gz`
done

The second domain was lower cased, any way this is still, slow for the reasons i told you before! bye!

By: Juan C Lopez

Juan C Lopez — Wed, 21 Jan 2009 23:55:13 +0000

Hello I try your script and is very interesting the aproach (how ever I got the same number of emails for all domain why), but I see it very REDOUNDANT, why? First you are opening directly a GZiped file, this consumes a Processor time, and memory, as you said it can be done unziping it before), but the problem is that you are doing this process, every time, for each domain in the server, so for a real case (like me), the numbers are:

122 Total Sites
8-10mb maillog.gz files
Time for each site 10-15 secs
Total time: 21-25 mins

Im not a SHELL programer so I cant write the script (I did’n even know that you can access MySQL from SHELL LOL), but the script sould do something like this:

1) Store a list of the domains (some how, an array Maybe)
2) Open the Maillog.gz file
3) run grep for all the to= and from=
4) if a domain from the domains list count it (maybe an other literal array in php like $domain['domain.com']++ )
then at the end print results.