RE: [squid-users] squid2.7 Stable 6 passes in intervals where cpu usage hits 100%

Hi Chris,

Thank you for the reply. I will use squid -k debug to check what is going
on.

As for the additional info sorry for not clearing the squid setup more
anyway this is squid configuration values you have guessed as taken from my
squid.conf

Wild guesses based on the information given:

*) You are using UFS for your cache_dir instead of AUFS.

cache_dir aufs /cache1 115000 16 256
cache_dir aufs /cache2 115000 16 256

I am using AUFS not UFS.

*) Your cache is pretty large and your cache_swap_high and
cache_swap_low are still at the defaults

cache_swap_low 93
cache_swap_high 95

Do u think these values are reasonable enough regarding the above values of
my Cacche dir or should they be changed.

*) You are using large lists of regex ACLs

acl videocache_allow_url url_regex -i \.youtube\.com\/get_video\?
acl videocache_allow_url url_regex -i \.googlevideo\.com\/videoplayback
\.googlevideo\.com\/get_video\?
acl videocache_allow_url url_regex -i \.google\.com\/videoplayback
\.google\.com\/get_video\?
acl videocache_allow_url url_regex -i \.google\.[a-z][a-z]\/videoplayback
\.google\.[a-z][a-z]\/get_video\?
acl videocache_allow_url url_regex -i
(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]
?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][
0-9]?)\/videoplayback\?
acl videocache_allow_url url_regex -i
(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]
?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][
0-9]?)\/get_video\?
acl videocache_allow_url url_regex -i
proxy[a-z0-9\-][a-z0-9][a-z0-9][a-z0-9]?\.dailymotion\.com\/
acl videocache_allow_url url_regex -i vid\.akm\.dailymotion\.com\/
acl videocache_allow_url url_regex -i
[a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-z]?\.xtube\.com\/(.*)flv
acl videocache_allow_url url_regex -i bitcast\.vimeo\.com\/vimeo\/videos\/
acl videocache_allow_url url_regex -i
va\.wrzuta\.pl\/wa[0-9][0-9][0-9][0-9]?
acl videocache_allow_url url_regex -i \.files\.youporn\.com\/(.*)\/flv\/
acl videocache_allow_url url_regex -i \.msn\.com\.edgesuite\.net\/(.*)\.flv
acl videocache_allow_url url_regex -i
media[a-z0-9]?[a-z0-9]?[a-z0-9]?\.tube8\.com\/
mobile[a-z0-9]?[a-z0-9]?[a-z0-9]?\.tube8\.com\/
acl videocache_allow_url url_regex -i \.mais\.uol\.com\.br\/(.*)\.flv
acl videocache_allow_url url_regex -i
\.video[a-z0-9]?[a-z0-9]?\.blip\.tv\/(.*)\.(flv|avi|mov|mp3|m4v|mp4|wmv|rm|r
am)
acl videocache_allow_url url_regex -i video\.break\.com\/(.*)\.(flv|mp4)
acl videocache_allow_dom dstdomain v.mccont.com dl.redtube.com
.cdn.dailymotion.com
acl videocache_deny_url url_regex -i http:\/\/[a-z][a-z]\.youtube\.com
http:\/\/www\.youtube\.com

acl bad_requests urlpath_regex -i cmd.exe \/bin\/sh default\.ida?XXXXXXX
omg.pif

acl music url_regex -i .wav
acl video url_regex -i .avi .mpe
acl cddown url_regex -i .iso .raw

These are all the acl regex entries I use in my squid.conf file mainly most
of them are those of videocache.

I will use the squid -k debug and try and get more info of what is going on
during the high cpu usage period and will share whatever I find on
squid-users mail list.

Thanks Chris for your support.

Ragheb

-----Original Message-----
From: crobertson_at_gci.net [mailto:crobertson_at_gci.net]
Sent: Friday, May 29, 2009 10:18 PM
To: squid-users_at_squid-cache.org
Subject: Re: [squid-users] squid2.7 Stable 6 passes in intervals where cpu
usage hits 100%

Ragheb Rustom wrote:
> Dear All,
>
> I have been noticing for some time now that my squid server passes in
nearly
> regular intervals during the day where the squid process CPU usage hits
100%
> for around 20 - 30 seconds or so during which squid will not serve
requests.
> After these 20 -30sec the squid CPU usage drops to around 5 - 13% and
> website navigation is normal again. This happens like I said before at
> nearly regular intervals during each day several times and it happens only
> for around 20 -30sec. I have been observing the cache.log file but there
is
> nothing apparent there. Is there a way that I know what squid is doing
when
> this problem happens to try and resolve it as trying to solve it like it
is
> now with no info about what is going on is somewhat vague.

squid -k debug

> I think this
> problem happened after I have changed memory and disk replacement policies
> from lru to heap but I am not so sure that this is the source of the
> problem. I am using squid2.7-Stable6 on a fedora9 server which is a dual
> xeon quad 2.8Ghz CPU with 16Gb of Ram installed and 3 SAS hard drives. One
> more thing this server is also running videocache 1.9.1 but it has been
> running videocache also before the problem started with no problems
> whatsoever. I appreciate any help you can offer me.
>

Wild guesses based on the information given:

*) You are using UFS for your cache_dir instead of AUFS.
*) Your cache is pretty large and your cache_swap_high and
cache_swap_low are still at the defaults
*) You are using large lists of regex ACLs

> Sincerely,
>
> Ragheb Rustom
> Smartelecom S.A.R.L
> Sin el fil - Mar Elias Street
> Absi Center - Ground Floor
> Beirut, Lebanon
> Email: ragheb_at_smartelecom.org
>

Chris
Received on Sat May 30 2009 - 07:25:48 MDT