Check netstat -mb and see if you're running out of mbufs?
You haven't mentioned whether the CPU is being pegged at this point?
Adrian
On Fri, Nov 09, 2007, Dave Raven wrote:
> Hi all,
> Okay I've done some of what you requested, and unfortunately failed
> to find anything specific. I can pretty much guarantee the times at which
> the requests will slow down now. 600RPS = 15 minutes, 800 RPS = 11 minutes,
> 400 RPS = ~80 minutes.
>
> During that time (before and during the problem) systat -vmstat 1 shows the
> same interrupts - about 4000 on em1 (ifac) and 250 on hptmv0 - my controller
> for the SATA drives.
>
> If I use a systat -iostat 1 I can see that none of the drives are 100%
> utilized at any time during the test. Systat -tcp 1 also doesn't show me
> anything out of the ordinary. I have setup munin to monitor the host but
> unfortunately its not showing much.
>
> Also the problem is that when the problem begins, it starts filling up
> network connections - once it fills all the available ports nothing can
> monitor it :/
>
> I'm going to try use a different network card, then a different motherboard
> etc - try some different setups today. Thanks again for all the help and
> please let me know if anyone has any ideas...
>
> Thanks
> Dave
>
> -----Original Message-----
> From: Adrian Chadd [mailto:adrian@creative.net.au]
> Sent: Friday, November 09, 2007 4:08 AM
> To: Dave Raven
> Cc: squid-users@squid-cache.org
> Subject: Re: [squid-users] Squid Performance (with Polygraph)
>
> On Thu, Nov 08, 2007, Dave Raven wrote:
> > Hi Adrian,
> > What would cause it to fail after a specific time though - if the
> cache_mem
> > is already full and its using the drives? I would have thought it would
> fail
> > immediately ?
> >
> > Also there are no log messages about failures or anything...
>
> Who knows :) its hard without having remote access, or lots of logging/
> statistics to correlate the trouble times with.
>
> Try installing munin and graph all the system-specific stuff. See what
> correlates against the failure time. You might notice something, like
> out of memory/paging, or an increase in interrupts, or something. ;)
>
> Thats all I can offer at the present time, sorry.
>
>
>
> Adrian
>
> --
> - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid
> Support -
> - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
-- - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support - - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -Received on Fri Nov 09 2007 - 02:51:22 MST
This archive was generated by hypermail pre-2.1.9 : Sat Dec 01 2007 - 12:00:02 MST