commandlinefu.com is the place to record those command-line gems that you return to again and again.
You can sign-in using OpenID credentials, or register a traditional username and password.
Subscribe to the feed for:
Creates a file with contents like `du -a`, only it is remote server filesystem hierarchy. Very usefull then for grep-ing without remote connection.
Make sure the file you use in your test is > 50mb to get good results.
sudo apt-get install lftp iperf
This is for files only, for directories 'mirror' has to be used.
It works best if you first login and then do the fetch:
lftp -u user,pass ftp://site.com/
mirror -c --parallel=3 --use-pget-n=5 "Some folder"
wget/curl/friends are not good with mirroring files off websites, especially those with Apache-generated directory listings. These tools endlessly waste time downloading useless index HTML pages. lftp's mirror command does a better job without the mess.