Re: [squid-users] Squid not caching images/content from certain websites

Dear Amos,

Thank you for taking the time to reply. I'll try to reflect in-line...

2014.03.10. 14:12 keltezéssel, Amos Jeffries írta:
> redbot.org tools say:
>
> * Vary: Host is not necessary.
> * This response allows a cache to assign its own freshness lifetime.
> * A ranged request returned another representation.
> * An If-Modified-Since conditional request returned the full content
> unchanged.
> * The ETag doesn't change between negotiated representations.
> * Cache-Control: public is rarely necessary.
> * The If-Modified-Since response is missing required headers.
> * The ETag header's syntax isn't valid.

Following your example, I went ahead and tested two pictures of note
from two sites. According to this direct test:

http://redbot.org/?uri=http%3A%2F%2Fwww.moovie.cc%2Fimages%2Fmovies%2F17031%2Fposter.jpg

General

    The server's clock is correct.
    The Content-Length header is correct.

Caching

    The resource last changed 70 days 20 hr ago.
    This response allows all caches to store it.
    This response is fresh until 62 days from now.
    This response may still be served by a cache once it becomes stale.
    Cache-Control: public is rarely necessary.

Validation

    If-Modified-Since conditional requests are supported.

Partial Content

    A ranged request returned another representation.

... only the last one seems too problematic (for me), since most of
these like the modification time are overridden (if im correct) by that
exaggerating refresh pattern i constructed.

Looking at the other example:

http://redbot.org/?uri=http%3A%2F%2Fwww.szerencsejatek.hu%2Fbanner%2Fsegelyvonal.jpg

General

    The server's clock is correct.
    The Content-Length header is correct.

Caching

    The resource last changed 131 days 23 hr ago.
    This response allows all caches to store it.
    Vary: Host is not necessary.
    This response allows a cache to assign its own freshness lifetime.

Validation

    If-Modified-Since conditional requests are supported.
    If-None-Match conditional requests are supported.

Partial Content

    A ranged request returned the correct partial content.

... my not-too-keen eyes dont see much in common. So I'm still baffled.

> Could be you have a version of Squid which had Vary caching bugs. Or
> one of the issues redbot points out.

I'm not sure but... Here's all the version and info I can give off the
top of my head:

#uname -a
Linux tradestation5.warbird 3.13.5-202.fc20.i686+PAE #1 SMP Mon Mar 3
19:26:26 UTC 2014 i686 i686 i386 GNU/Linux

# squid -v
Squid Cache: Version 3.3.11
configure options: '--build=i686-redhat-linux-gnu'
'--host=i686-redhat-linux-gnu' '--program-prefix=' '--prefix=/usr'
'--exec-prefix=/usr' '--bindir=/usr/bin' '--sbindir=/usr/sbin'
'--sysconfdir=/etc' '--datadir=/usr/share' '--includedir=/usr/include'
'--libdir=/usr/lib' '--libexecdir=/usr/libexec'
'--sharedstatedir=/var/lib' '--mandir=/usr/share/man'
'--infodir=/usr/share/info' '--exec_prefix=/usr'
'--libexecdir=/usr/lib/squid' '--localstatedir=/var'
'--datadir=/usr/share/squid' '--sysconfdir=/etc/squid'
'--with-logdir=$(localstatedir)/log/squid'
'--with-pidfile=$(localstatedir)/run/squid.pid'
'--disable-dependency-tracking' '--enable-eui'
'--enable-follow-x-forwarded-for' '--enable-auth'
'--enable-auth-basic=DB,LDAP,MSNT,MSNT-multi-domain,NCSA,NIS,PAM,POP3,RADIUS,SASL,SMB,getpwnam'
'--enable-auth-ntlm=smb_lm,fake'
'--enable-auth-digest=file,LDAP,eDirectory'
'--enable-auth-negotiate=kerberos'
'--enable-external-acl-helpers=file_userip,LDAP_group,time_quota,session,unix_group,wbinfo_group'
'--enable-cache-digests' '--enable-cachemgr-hostname=localhost'
'--enable-delay-pools' '--enable-epoll' '--enable-icap-client'
'--enable-ident-lookups' '--with-large-files' '--enable-linux-netfilter'
'--enable-removal-policies=heap,lru' '--enable-snmp' '--enable-ssl'
'--enable-ssl-crtd' '--enable-storeio=aufs,diskd,ufs' '--enable-wccpv2'
'--enable-esi' '--enable-ecap' '--with-aio' '--with-default-user=squid'
'--with-dl' '--with-openssl' '--with-pthreads'
'build_alias=i686-redhat-linux-gnu' 'host_alias=i686-redhat-linux-gnu'
'CFLAGS=-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
-fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches
 -m32 -march=i686 -mtune=atom -fasynchronous-unwind-tables -fpie'
'LDFLAGS=-Wl,-z,relro -pie -Wl,-z,relro -Wl,-z,now' 'CXXFLAGS=-O2 -g
-pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
-fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches
 -m32 -march=i686 -mtune=atom -fasynchronous-unwind-tables -fpie'
'PKG_CONFIG_PATH=%{_PKG_CONFIG_PATH}:/usr/lib/pkgconfig:/usr/share/pkgconfig'

# yum info squid
Loaded plugins: langpacks, refresh-packagekit
Installed Packages
Name : squid
Arch : i686
Epoch : 7
Version : 3.3.11
Release : 3.fc20
Size : 8.7 M
Repo : installed
From repo : updates
Summary : The Squid proxy caching server
URL : http://www.squid-cache.org
License : GPLv2+ and (LGPLv2+ and MIT and BSD and Public Domain)
Description : Squid is a high-performance proxy caching server for Web
clients,
            : supporting FTP, gopher, and HTTP data objects. Unlike
traditional
            : caching software, Squid handles all requests in a single,
            : non-blocking, I/O-driven process. Squid keeps meta data
and especially
            : hot objects cached in RAM, caches DNS lookups, supports
non-blocking
            : DNS lookups, and implements negative caching of failed
requests.
            :
            : Squid consists of a main server program squid, a Domain
Name System
            : lookup program (dnsserver), a program for retrieving FTP data
            : (ftpget), and some management and client tools.

Regards,

Levente