[squid-users] Cache Partition Problem

From: <squid_at_sourcesystemsonline.com>
Date: Wed, 2 Mar 2011 07:10:48 -0500

Hi,
I have Four (4) partitions for my cache directory and occasionally one of
the cache directory will get full and low disk error is displayed and
squid stop responding to request. After some times or days squid rebuilds
and said cache directory is free of space, why?
Why is squid keeps rebuilding most of the time?
Is there any configuration option to adjust the cache dir re(building)
operations?
Below is extract from my cache log.
Regards,
Yomi.

2011/02/16 09:25:37| Starting Squid Cache version 2.7.STABLE8 for
i686-pc-winnt...
2011/02/16 09:25:37| Running as squid Windows System Service on Windows Vista
2011/02/16 09:25:37| Service command line is:
2011/02/16 09:25:37| Process ID 1476
2011/02/16 09:25:37| With 2048 file descriptors available
2011/02/16 09:25:37| With 2048 CRT stdio descriptors available
2011/02/16 09:25:37| Windows sockets initialized
2011/02/16 09:25:37| Using select for the IO loop
2011/02/16 09:25:37| Performing DNS Tests...
2011/02/16 09:25:37| Successful DNS name lookup tests...
2011/02/16 09:25:37| DNS Socket created at 0.0.0.0, port 55679, FD 5
2011/02/16 09:25:37| Adding DHCP nameserver 62.173.32.89 from Registry
2011/02/16 09:25:37| Adding DHCP nameserver 62.173.34.222 from Registry
2011/02/16 09:25:37| Adding DHCP nameserver 192.168.0.1 from Registry
2011/02/16 09:25:37| Adding DHCP nameserver 192.168.0.1 from Registry
2011/02/16 09:25:37| Adding domain from Registry
2011/02/16 09:25:37| logfileOpen: opening log d:/squid/var/logs/useragent.log
2011/02/16 09:25:37| logfileOpen: opening log d:/squid/var/logs/referer.log
2011/02/16 09:25:37| logfileOpen: opening log d:/squid/var/logs/access.log
2011/02/16 09:25:37| Unlinkd pipe opened on FD 10
2011/02/16 09:25:37| Swap maxSize 89128960 + 1048576 KB, estimated 6936733
objects
2011/02/16 09:25:37| Target number of buckets: 346836
2011/02/16 09:25:37| Using 524288 Store buckets
2011/02/16 09:25:37| Max Mem size: 1048576 KB
2011/02/16 09:25:37| Max Swap size: 89128960 KB
2011/02/16 09:25:37| Local cache digest enabled; rebuild/rewrite every
3600/3600 sec
2011/02/16 09:25:37| Store logging disabled
2011/02/16 09:25:37| Rebuilding storage in c:/squid/var/cache (DIRTY)
2011/02/16 09:25:37| Rebuilding storage in d:/squid/var/cache (DIRTY)
2011/02/16 09:25:37| Rebuilding storage in e:/squid/var/cache (DIRTY)
2011/02/16 09:25:37| Rebuilding storage in f:/squid/var/cache (DIRTY)
2011/02/16 09:25:37| Using Least Load store dir selection
2011/02/16 09:25:37| Set Current Directory to c:/squid/var/cache
2011/02/16 09:25:37| Loaded Icons.
2011/02/16 09:25:38| Accepting proxy HTTP connections at 0.0.0.0, port
3128, FD 21.
2011/02/16 09:25:38| Accepting ICP messages at 0.0.0.0, port 3130, FD 22.
2011/02/16 09:25:38| Accepting HTCP messages on port 4827, FD 23.
2011/02/16 09:25:38| Accepting SNMP messages on port 3401, FD 24.
2011/02/16 09:25:38| Ready to serve requests.
2011/02/16 09:25:38| Done reading e:/squid/var/cache swaplog (11 entries)
2011/02/16 09:25:38| Store rebuilding is 0.0% complete
2011/02/16 09:25:53| Store rebuilding is 1.1% complete
2011/02/16 09:26:08| Store rebuilding is 2.2% complete
2011/02/16 09:26:23| Store rebuilding is 3.3% complete
2011/02/16 09:26:38| Store rebuilding is 4.5% complete
2011/02/16 09:26:53| Store rebuilding is 5.6% complete
2011/02/16 09:27:08| Store rebuilding is 6.8% complete
2011/02/16 09:27:23| Store rebuilding is 8.0% complete
2011/02/16 09:27:38| Store rebuilding is 9.3% complete
2011/02/16 09:27:53| Store rebuilding is 10.6% complete
2011/02/16 09:28:08| Store rebuilding is 11.9% complete
2011/02/16 09:28:23| Store rebuilding is 13.4% complete
2011/02/16 09:28:38| Store rebuilding is 14.8% complete
2011/02/16 09:28:53| Store rebuilding is 16.3% complete
2011/02/16 09:29:08| Store rebuilding is 17.7% complete
2011/02/16 09:29:23| Store rebuilding is 19.2% complete
2011/02/16 09:29:38| Store rebuilding is 20.6% complete
2011/02/16 09:29:53| Store rebuilding is 22.1% complete
2011/02/16 09:30:08| Store rebuilding is 23.6% complete
2011/02/16 09:30:23| Store rebuilding is 25.0% complete
2011/02/16 09:30:38| Store rebuilding is 26.5% complete
2011/02/16 09:30:53| Store rebuilding is 28.0% complete
2011/02/16 09:31:08| Store rebuilding is 29.5% complete
2011/02/16 09:31:23| Store rebuilding is 30.9% complete
2011/02/16 09:31:38| Store rebuilding is 32.4% complete
2011/02/16 09:31:53| Store rebuilding is 33.9% complete
2011/02/16 09:32:08| Store rebuilding is 35.4% complete
2011/02/16 09:32:23| Store rebuilding is 36.8% complete
2011/02/16 09:32:38| Store rebuilding is 38.3% complete
2011/02/16 09:32:53| Store rebuilding is 39.8% complete
2011/02/16 09:33:08| Store rebuilding is 41.3% complete
2011/02/16 09:33:23| Store rebuilding is 42.8% complete
2011/02/16 09:33:38| Store rebuilding is 44.2% complete
2011/02/16 09:33:53| Store rebuilding is 45.8% complete
2011/02/16 09:34:08| Store rebuilding is 47.3% complete
2011/02/16 09:34:11| CACHEMGR: <unknown>@127.0.0.1 requesting 'info'
2011/02/16 09:34:23| Store rebuilding is 48.7% complete
2011/02/16 09:34:38| Store rebuilding is 50.2% complete
2011/02/16 09:34:53| Store rebuilding is 51.7% complete
2011/02/16 09:35:08| Store rebuilding is 53.2% complete
2011/02/16 09:35:23| Store rebuilding is 54.6% complete
2011/02/16 09:35:38| Store rebuilding is 56.1% complete
2011/02/16 09:35:53| Store rebuilding is 57.6% complete
2011/02/16 09:36:08| Store rebuilding is 59.1% complete
2011/02/16 09:36:23| Store rebuilding is 60.5% complete
2011/02/16 09:36:38| Store rebuilding is 62.0% complete
2011/02/16 09:36:53| Store rebuilding is 63.5% complete
2011/02/16 09:37:08| Store rebuilding is 65.0% complete
2011/02/16 09:37:23| Store rebuilding is 66.5% complete
2011/02/16 09:37:38| Store rebuilding is 68.0% complete
2011/02/16 09:37:53| Store rebuilding is 69.5% complete
2011/02/16 09:38:08| Store rebuilding is 70.9% complete
2011/02/16 09:38:23| Store rebuilding is 72.4% complete
2011/02/16 09:38:38| Store rebuilding is 73.9% complete
2011/02/16 09:38:53| Store rebuilding is 75.3% complete
2011/02/16 09:39:08| Store rebuilding is 76.8% complete
2011/02/16 09:39:23| Store rebuilding is 78.3% complete
2011/02/16 09:39:38| Store rebuilding is 79.8% complete
2011/02/16 09:39:53| Store rebuilding is 81.2% complete
2011/02/16 09:40:08| Store rebuilding is 82.7% complete
2011/02/16 09:40:23| Store rebuilding is 84.2% complete
2011/02/16 09:40:38| Store rebuilding is 85.7% complete
2011/02/16 09:40:53| Store rebuilding is 87.1% complete
2011/02/16 09:41:08| Store rebuilding is 88.7% complete
2011/02/16 09:41:23| Store rebuilding is 90.2% complete
2011/02/16 09:41:38| Store rebuilding is 91.7% complete
2011/02/16 09:41:53| Store rebuilding is 93.2% complete
2011/02/16 09:42:08| Store rebuilding is 94.8% complete
2011/02/16 09:42:23| Store rebuilding is 96.3% complete
2011/02/16 09:42:34| Done reading c:/squid/var/cache swaplog (28832777
entries)
2011/02/16 09:42:38| Store rebuilding is 97.8% complete
2011/02/16 09:42:53| Store rebuilding is 98.9% complete
2011/02/16 09:43:06| Done reading f:/squid/var/cache swaplog (29939800
entries)
2011/02/16 09:43:07| Done reading d:/squid/var/cache swaplog (29939890
entries)
2011/02/16 09:43:07| Finished rebuilding storage from disk.
2011/02/16 09:43:07| 44358346 Entries scanned
2011/02/16 09:43:07| 0 Invalid entries.
2011/02/16 09:43:07| 0 With invalid flags.
2011/02/16 09:43:07| 37246661 Objects loaded.
2011/02/16 09:43:07| 0 Objects expired.
2011/02/16 09:43:07| 37242428 Objects cancelled.
2011/02/16 09:43:07| 842589 Duplicate URLs purged.
2011/02/16 09:43:07| 6269159 Swapfile clashes avoided.
2011/02/16 09:43:07| Took 1049.9 seconds (35476.7 objects/sec).
2011/02/16 09:43:07| Beginning Validation Procedure
2011/02/16 09:43:07| Completed Validation Procedure
2011/02/16 09:43:07| Validated 4170 Entries
2011/02/16 09:43:07| store_swap_size = 62576k
2011/02/16 09:43:07| storeLateRelease: released 9 objects
Received on Wed Mar 02 2011 - 12:10:56 MST

This archive was generated by hypermail 2.2.0 : Thu Mar 03 2011 - 12:00:01 MST