Re: [squid-users] Unable to increase filedescriptor limit -- tried all things

I have tried it also, but in log files it still saying
1024 file descriptors available. while squid is
compile with 8192.

--- Adrian Chadd <adrian@creative.net.au> wrote:

> Try running squid manually; see if that works
> better.
>
>
>
> Adrian
>
> On Fri, Jan 25, 2008, bijayant kumar wrote:
> > Hi,
> > I did recompiled squid and entere the first line
> in
> > /etc/init.d/squid as
> > ulimit -n 8192
> >
> > and output of squid -v
> >
> > configure options: '--prefix=/usr'
> > '--host=i686-pc-linux-gnu'
> '--mandir=/usr/share/man'
> > '--infodir=/usr/share/info' '--datadir=/usr/share'
> > '--sysconfdir=/etc' '--localstatedir=/var/lib'
> > '--sysconfdir=/etc/squid'
> > '--libexecdir=/usr/libexec/squid'
> > '--localstatedir=/var'
> '--datadir=/usr/share/squid'
> > '--enable-auth=basic,digest,ntlm'
> > '--enable-removal-policies=lru,heap'
> > '--enable-digest-auth-helpers=password'
> >
>
'--enable-basic-auth-helpers=PAM,LDAP,getpwnam,NCSA,MSNT'
> >
>
'--enable-external-acl-helpers=ldap_group,ip_user,session,unix_group'
> > '--enable-ntlm-auth-helpers=fakeauth'
> > '--enable-ident-lookups' '--enable-useragent-log'
> > '--enable-cache-digests' '--enable-delay-pools'
> > '--enable-referer-log' '--enable-arp-acl'
> > '--with-pthreads' '--with-large-files'
> '--enable-htcp'
> > '--enable-carp' '--enable-follow-x-forwarded-for'
> > '*******--with-maxfd=8192****' '--enable-snmp'
> > '--enable-ssl'
> > '--enable-storeio=ufs,diskd,coss,aufs,null'
> > '--enable-async-io' '--enable-linux-netfilter'
> > '--enable-epoll' '--build=i686-pc-linux-gnu'
> > 'build_alias=i686-pc-linux-gnu'
> > 'host_alias=i686-pc-linux-gnu'
> > 'CC=i686-pc-linux-gnu-gcc' 'CFLAGS=-O2 -march=i686
> '
> >
> > But while restarting squid it still says
> >
> > 2008/01/25 11:33:25| With 1024 file descriptors
> > available
> >
> > Please help me
> >
> > --- Adrian Chadd <adrian@creative.net.au> wrote:
> >
> > > Check ./squid -v ; see what it was compiled
> with.
> > > Make sure you start squid after you change the
> > > default ulimit.
> > > Either put "ulimit -n 8192" at the top of the
> squid
> > > startup
> > > script or find the place where your default
> ulimits
> > > are set
> > > and modify that.
> > >
> > >
> > >
> > > Adrian
> > >
> > > On Fri, Jan 25, 2008, bijayant kumar wrote:
> > > > Hi,
> > > >
> > > > While checking the squid-2.6.17.ebuild file i
> > > found in
> > > > econf section there is a line
> --with-maxfd=8192.
> > > It
> > > > means that squid has been compiled with 8192
> > > > descriptors, right ?? But in cache.log it says
> > > 1024
> > > > file descriptors are available and complains
> about
> > > the
> > > > running out of file descriptors. Shall i have
> to
> > > > recompile squid again in this case also ??
> > > > Please guide me
> > > >
> > > >
> > > >
> > > > --- Manoj_Rajkarnikar <manoj@vianet.com.np>
> wrote:
> > > >
> > > > > On Fri, 25 Jan 2008, bijayant kumar wrote:
> > > > >
> > > > > > Hi Arana,
> > > > > >
> > > > > > Thanks for your reply. As you are
> suggesting
> > > in
> > > > > your
> > > > > > reply that incresing the filedescriptor
> can be
> > > > > > dangerous. Is there any other way to get
> rid
> > > of
> > > > > this
> > > > > > warning, because this warning makes
> browsing
> > > dead
> > > > > > slow,and the box is deployed at our client
> > > place.
> > > > > I
> > > > > > have to do things fast. If you have any
> other
> > > > > > suggestion besides the increasing file
> > > descriptor
> > > > > > please suggest me.
> > > > > >
> > > > >
> > > > > No AFAIK. you'll have to raise the FD limit
> but
> > > > > don't raise it to tooo
> > > > > high - that was the suggestion.. set it to
> 2048
> > > or
> > > > > 4096 to meet the
> > > > > current and near-future workload requirement
> and
> > > > > increase it again in the
> > > > > future if needed...
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --- Gonzalo Arana
> <gonzalo.arana@gmail.com>
> > > wrote:
> > > > > >
> > > > > >> I would recommend you to run ./configure
> with
> > > > > >> --with-maxfd=you_desired_limit and
> > > --enable-epoll
> > > > > >>
> > > > > >> Watch for messages like this in configure
> > > output:
> > > > > >> checking if epoll works... yes
> > > > > >> Using epoll for the IO loop.
> > > > > >> ...
> > > > > >> Maximum filedescriptors set to 131072
> > > > > >> ...
> > > > > >>
> > > > > >> Having large number of FDs with select is
> > > > > dangerous.
> > > > > >> Also, I recall
> > > > > >> there was an issue on increasing
> FD_SETSIZE
> > > on
> > > > > glibc
> > > > > >> (Linux uses
> > > > > >> glibc).
> > > > > >>
> > > > > >> HTH,
> > > > > >>
> > > > > >> On Jan 24, 2008 11:46 AM, Bijayant
> > > > > >> <bijayant4u@yahoo.com> wrote:
> > > > > >>> Hello list,
> > > > > >>>
> > > > > >>> I am using squid as proxy server on
> gentoo
> > > box.
> > > > > >> All of a sudden from
> > > > > >>> 2nd January in my cache.log i am seeing
> the
> > > > > error
> > > > > >>>
> > > > > >>> WARNING! Your cache is running out of
> > > > > >> filedescriptors
> > > > > >>>
> > > > > >>> When this messages repeats frequently,
> > > browsing
> > > > > >> becomes dead slow in
> > > > > >>> 2mbps line. We have 2GB RAM, and 1 GB
> swap
> > > ,
> > > > > dual
> > > > > >> core processor system.
> > > > > >>>
> > > > > >>> After googling, checking Squid Faq i
> have
> > > tried
> > > > > to
> > > > > >> increase the limit
> > > > > >>> of filedescriptors on my system. But i
> am
> > > not
> > > > > >> able to do. Please help me
> > > > > >>> out. here i am giving some information
> for
> > > > > better
> > > > > >> picture
> > > > > >>>
> > > > > >>> OS - gentoo
> > > > > >>> Kernel - 2.6.18-gentoo-r6
> > > > > >>> Squid - net-proxy/squid-2.6.12
> > > > > >>> USE Flags=ipf-transparent pam
> ssl
> > > > > >>>
> > > > > >>> I have changed the filedescriptors in
> > > > > >> /usr/include/bits/typesizes.h
> > > > > >>>
> > > > > >>> Number of descriptors that can fit in an
> > > > > `fd_set'
> > > > > >>> #define __FD_SETSIZE 2048
> > > > > >>>
> > > > > >>>
> > > > > >>> In /etc/init.d/squid
> > > > > >>> ulimit -HSn 2048
> > > > > >>>
> > > > > >>> ~ $ cat /proc/sys/fs/file-max
> > > > > >>> 50516
> > > > > >>>
> > > > > >>> The relevant part of
> /etc/squid/squid.conf
> > > after
> > > > > >> search on google/faq
> > > > > >>>
> > > > > >>>
> > > > > >>> client_persistent_connections off
> > > > > >>> server_persistent_connections off
> > > > > >>> cache_dir ufs /var/cache/squid 2000 16
> 256
> > > > > >>> url_rewrite_children 30
> > > > > >>>
> > > > > >>>
> > > > > >>> I did all things specified in Squid Wiki
> and
> > > > > Faq.
> > > > > >> After that i have
> > > > > >>> recompiled the squid and rebooted my
> > > machine
> > > > > also
> > > > > >> without any luck. I am
> > > > > >>> still getting the warning in my logs,
> and
> > > > > ulimit
> > > > > >> -n as 1024.
> > > > > >>>
> > > > > >>> I have tried all possible things without
> any
> > > > > >> success. Please help me or
> > > > > >>> give me some direction.
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> Gonzalo A. Arana
> > > > > >>
> > > > > >
> > > > > >
> > > > > > Bijayant Kumar
> > > > > >
> > > > > > Send instant messages to your online
> friends
> > > > > http://uk.messenger.yahoo.com
> > > > > >
> > > > >
> > > > > --
> > > > >
> > > >
> > > >
> > > > Bijayant Kumar
> > > >
> > > > Send instant messages to your online friends
> > > http://uk.messenger.yahoo.com
> > >
> > > --
> > > - Xenion - http://www.xenion.com.au/ - VPS
> Hosting -
> > > Commercial Squid Support -
> > > - $25/pm entry-level VPSes w/ capped bandwidth
> > > charges available in WA -
> > >
> >
> >
> > Bijayant Kumar
> >
> > Send instant messages to your online friends
> http://uk.messenger.yahoo.com
>
> --
> - Xenion - http://www.xenion.com.au/ - VPS Hosting -
> Commercial Squid Support -
> - $25/pm entry-level VPSes w/ capped bandwidth
> charges available in WA -
>

Bijayant Kumar

Send instant messages to your online friends http://uk.messenger.yahoo.com
Received on Thu Jan 24 2008 - 23:57:49 MST