Re: [squid-users] Squid CPU 100% infinite loop

Some ideas here.
http://www.freeproxies.org/blog/2007/10/03/squid-cache-disk-io-performance-enhancements/
http://www.gcsdstaff.org/roodhouse/?p=2784

You might try dropping your disk cache to 50Gb and see what happens.
I am not sure that caching 7 Million pages gives you much of an
advantage over 1 million.
The 1,000,001th most popular page probably does not come up that often
and by the time you get down to a page that is 7,000,000 in the list of
most accessed pages, you are not seeing much demand for that page.
Probably most of the cache is just accessed once.

Your cache_mem looks low but is not related to your problem but would
improve performance a lot.
Getting a few thousand of the most active pages in memory is worth a lot
more than 6 million of the least active pages sitting on a disk.

I am not a big squid expert but have run squid for a long time.

Ron

On 30/05/2013 10:55 AM, Mike Mitchell wrote:
> What garbage collection parameters can I change?
> I'm not using authentication, so the default
> auth_param digest nonce_garbage_interval 5 minutes
> doesn't really apply.
> I also run with
> client_db off
> so the default
> authenticate_cache_garbage_interval 1 hour
> doesn't apply either.
>
> The lock-up happens randomly across the four servers. I can go several
> days without a lock-up. I've only seen one lock-up in a night. Over the
> last two nights I had lock-ups both nights, but on different servers.
>
> # squid -v
> Squid Cache: Version 3.2.11-20130524-r11822
> configure options: '--prefix=/opt/squid' '--with-maxfd=16384' '--with-pthreads' '--enable-storeio=aufs' '--enable-removal-policies=heap' '--disable-external-acl-helpers' '--disable-ipv6' --enable-ltdl-convenience
>
> Here are the relevant parts of the configuration:
>
> acl CIDR_A src 10.0.0.0/8
> ident_lookup_access allow CIDR_A
> http_port 3128
> cache_mem 1024 MB
> memory_replacement_policy heap GDSF
> cache_replacement_policy heap LFUDA
> cache_dir aufs /cache/squid 323368 64 253 max-size=5120000000
> maximum_object_size 5000000 KB
> cache_swap_low 95
> cache_swap_high 97
> cache_store_log none
> client_idle_pconn_timeout 5 seconds
> check_hostnames on
> allow_underscore on
> dns_defnames on
> dns_v4_first on
> ipcache_size 4096
> fqdncache_size 8192
> client_db off
>
> I have about 7,000,000 objects in the cache. During the four
> hours the CPU rises from 10% to 100%, the number of objects
> does not change by very much. The cache utilization sits at
> 95% during the four hours.
>
>

-- 
Ron Wheeler
President
Artifact Software Inc
email: rwheeler_at_artifact-software.com
skype: ronaldmwheeler
phone: 866-970-2435, ext 102