RE: [squid-users] processing many squid log files

----Original Message----
From: Chad Naugle [mailto:Chad.Naugle_at_travimp.com]
Sent: Friday, September 10, 2010 12:52 PM
To: Enrique; squid-users_at_squid-cache.org
Subject: Re: [squid-users] processing many squid log files

> SARG isn't the best analyzer,
> but there really isn't many other great choices.
>
>

If you have a little bit of time, it might be better to roll your own solution.

What I ended up doing was taking the log importer from MySAR (http://giannis.stoilis.gr/software/mysar/) and then creating my own reports using Perl cgi scripts. Everything I have are rough hacks -- I don't have time to prettify it. But it works. Eventually I'll have to re-write the log file importer, as I don't need some of the data in the MySAR schema.

The MySAR project looks like it is stagnant -- the last update was 2007. It works OK with Squid 2.7, but the built in PHP pages take a very very long time to load when you keep 365 days of data like I do and I think the really long reports aren't suitable for web pages anyway.

However the logfile importer from MySAR is a keeper. Once the data is dumped to MySQL it is very easy to pull what you need out of it with Perl or the language of your choice. Then for quick stuff you can display it on a web page, or for long running stuff you can create a spreadsheet with something like Spreadsheet::SimpleExcel and then e-mail the spreadsheet.

James Z
Received on Fri Sep 10 2010 - 21:17:12 MDT