Re: [squid-users] Squid 3 - Page Content

On Tue, 2003-10-21 at 21:31, Martin Ritchie wrote:
> Sorry if this is a total newbee question but I'm wanting to store the
> actual page content in a database is there anyone out there that has
> done anything like this? Do you have any pointers of where I should start.

Well, there are a few approaches. The simplest would be to tail
store.log, and copy out the objects as they are completed. You can use
ufsdump in the squid3 sources (cd src && make ufsdump) as a sample
application for examining a single cached object. Only a little work
would be needed to list all the metadata, and the byte offset that
actual data starts - from there you can insert that into your database.
(Be sure to take a local copy (not hardlink) first, so as to minimise
the occurences of the object being recycled before you get to it. You
can't do that with COSS though. A second approach would be a hacked
squid with a an external call out of some sort - perhaps iCap , although
the iCap patches are still only for 2.5.

> I'm also trying to figure out why I get "
> FATAL: neighborsUdpPing: There is no ICP socket!
> Aborted
> "

Sounds like a problem opening the icp sockets - check your udp_*
settings in squid.conf.

Cheers,
Rob

-- 
GPG key available at: <http://members.aardvark.net.au/lifeless/keys.txt>.