Boston Linux & Unix (BLU) Home | Calendar | Mail Lists | List Archives | Desktop SIG | Hardware Hacking SIG
Wiki | Flickr | PicasaWeb | Video | Maps & Directions | Installfests | Keysignings
Linux Cafe | Meeting Notes | Blog | Linux Links | Bling | About BLU

BLU Discuss list archive


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

ftp directory mirror via squid



At 11:03 AM 7/11/2005, Bob Gorman wrote:
>Quick question... when doing ftp via wget through a squid proxy server, how can one do a recursive directory mirror?
>
>        export ftp_proxy=http://proxy.my.com:3128
>        wget -m ftp://apt.sw.be/pub/dag/redhat/el4/en/i386/dag/
>
>And one gets a nice html file instead of the directory structure.
>
>Is there an easy way to work around this?  Or is there a better, simple, command line tool for doing an ftp mirror via squid?

I was able to use lftp for this.

lftp -c '
        set ftp:sync-mode 0
        set ftp:proxy http://proxy.my.com:3128
        mirror ftp://apt.sw.be/pub/dag/redhat/el4/en/i386/dag/
        '

The disabling synchronous issuing of ftp commands allowed lftp to run (about 8) concurrent ftp connections through squid.  Nice!





BLU is a member of BostonUserGroups
BLU is a member of BostonUserGroups
We also thank MIT for the use of their facilities.

Valid HTML 4.01! Valid CSS!



Boston Linux & Unix / webmaster@blu.org