> Hi!
>
> I just configured a squid server. My problem is to configure the server to auto-download (in the night hours) info from the most wanted sites.
> Probably this is "reinventing the wheel". In this case ... sorry!
>
> Marius
THE tool to use for ftp/http downloads on a unix box is wget, do a search
on las.gnu.net. I know there is a contrib RPM on RedHats site though...
Set your /etc/wgetrc file to point at your local proxy, and then you can
feed wget a list of URLs w/ maximum recursion depths, etc. There is a
seemingly undocumented wget flag --delete-after that deletes everything as
it is downloaded. Start this in /tmp/something, and just do a rm -Rf
/tmp/something afterwards.
Hope this helps....
-keith
>
> --
> ------ ___ --- Marius Panait, Technical Manager
> ----- / / / __ ___ _/_ ---- EUnet Romania S.R.L.
> ---- /--- / / / / /__/ / ----- Bd. Unirii 20, Bl.5C, Ap.1, Bucharest, RO
> --- /___ /__/ / / /__ / ------ Tel: +40 1 4.100.100, Fax: +40 1 410.38.83
> --- ------- 24hr emergency number: +40 92 24.00.00
> -- -------- E-mail: marius@Romania.EU.net
>
>
>
Received on Mon Jan 12 1998 - 02:21:26 MST
This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 16:38:23 MST