Re: [squid-users] what Squid access.log analyzer are you using?

Hi Eliezer,

> Since squid has new outputs in the access log I was wondering what
> analyzer are you using?
>
> I want to write a simple scripting (for practice) tool that will do
> things in a similar way that calamaris do.
>
> What statistics would be needed from such a tool?

I use SARG (that is, my customer uses), but it could be better. I've
worked with Calamaris before, and it did one thing SARG does not: update
reports without re-parsing past log entries. So I can run Calamaris
every 5 minutes to have reports updated in near real-time, even for high
traffic proxies. But my SARG takes almost half an hour to generate a
daily report.

Neither Calamaris nor SARG does one thing I want/need: upload bandwidth
reports. Both of them (and all other ones I researched) do only download
reports, but in today web, where too many apps upload data to servers,
upload bandwith is not so low anymore. Currently I have to generate two
sets of acces logs, the regular one for download reports, and another
one where I replace downloaded bytes by uploaded bytes, to generate a
second set of reports. Having one tool do both from the same logs,
without wasting time processing what is essentially the same log twice,
would be a big plus.

PS: There's also the issue of squid not reporting upload bytes for
CONNECT requests, that is, https requests. This would leave of the
report all upload bandwidth consume by Google services and other APIs,
which I suspect are the biggest consumers. :-(

[]s, Fernando Lozano
Received on Wed Aug 13 2014 - 18:02:46 MDT