Commands tagged download sorted by votes

Commands tagged download (36)

sorted by

Log your internet download speed

This will log your internet download speed. You can run gnuplot -persist <(echo "plot 'bps' with lines") to get a graph of it.
This is sample output - yours may be different.
10

echo $(date +%s) > start-time; URL=http://www.google.com; while true; do echo $(curl -L --w %{speed_download} -o/dev/null -s $URL) >> bps; sleep 10; done &

matthewbauer · 2009-09-19 21:26:06 0
Fetch every font from dafont.com to current folder

Requires aria2c but could just as easily wget or anything else. A great way to build up a nice font collection for Gimp without having to waste a lot of time. :-) Show Sample Output
This is sample output - yours may be different.
```
The current folder will fill with fonts :-)
```
10

d="www.dafont.com/alpha.php?";for c in {a..z}; do l=`curl -s "${d}lettre=${c}"|sed -n 's/.*ge=$[0-9]\{2\}$.*/\1/p'`;for((p=1;p<=l;p++));do for u in `curl -s "${d}page=${p}&lettre=${c}"|egrep -o "http\S*.com/dl/\?f=\w*"`;do aria2c "${u}";done;done;done

lrvick · 2010-05-18 07:38:54 0
Download file with multiple simultaneous connections

`aria2c` (from the aria2 project) allows. Change -s 4 to an arbitrary number of segments to control the number of concurrent connections. It is also possible to provide multiple URLs to the same content (potentially over multiple protocols) to download the file concurrently from multiple hosts.
This is sample output - yours may be different.
8

aria2c -s 4 http://my/url

jrk · 2009-08-11 22:34:00 4
Limit bandwidth usage by any program

Trickle is a voluntary, cooperative bandwidth shaper. it works entirely in userland and is very easy to use. The most simple application is to limit the bandwidth usage of programs.
This is sample output - yours may be different.
7

trickle -d 60 wget http://very.big/file

point_to_null · 2010-03-29 06:55:30 0
resume download using curl
This is sample output - yours may be different.
7

curl -C - -o partially_downloaded_file 'www.example.com/path/to/the/file'

weldabar · 2012-11-05 17:14:16 2
Stream and copy a video from lan

Requires a listening port on HOST eg. "cat movie.mp4 | nc -l 1356 " (cat movie.mp4 | nc -l PORT) Useful if you're impatient and want to watch a movie immediately and download it at the same time without using extra bandwidth. You can't seek (it'll crash and kill the stream) but you can pause it.
This is sample output - yours may be different.
7

nc HOST PORT | tee movie.mp4 | mplayer -

snipertyler · 2013-11-28 01:38:29 0
Securely stream (and save) a file from a remote server

Securely stream a file from a remote server (and save it locally). Useful if you're impatient and want to watch a movie immediately and download it at the same time without using extra bandwidth. This is an extension of snipertyler's idea. Note: This command uses an encrypted connection, unlike the original. Show Sample Output
This is sample output - yours may be different.
```
[mplayer output...]

$ ls
LOCAL_FILE.mp4
```
7

ssh USER@HOST cat REMOTE_FILE.mp4 | tee LOCAL_FILE.mp4 | mplayer -

flatcap · 2013-11-28 11:25:26 4
Download file with multiple simultaneous connections

jrk's aria2 example is incorrect. -s specifies the global connection limit; the per-host connection limit is specified with -x.
This is sample output - yours may be different.
6

aria2c -x 4 http://my/url

lx45803 · 2014-07-26 03:06:33 1
ThePirateBay.org torrent search

This one-liner greps first 30 direct URLs for .torrent files matching your search querry, ordered by number of seeds (descending; determined by the second number after your querry, in this case 7; for other options just check the site via your favorite web-browser). You don't have to care about grepping the torrent names as well, because they are already included in the .torrent URL (except for spaces and some other characters replaced by underscores, but still human-readable). Be sure to have some http://isup.me/ macro handy (someone often kicks the ethernet cables out of their servers ;) ). I've also coded a more user-friendly ash (should be BASH compatible) script, which also lists the total size of download and number of seeds/peers (available at http://saironiq.blogspot.com/2011/04/my-shell-scripts-4-thepiratebayorg.html - may need some tweaking, as it was written for a router running OpenWrt and transmission). Happy downloading!
This is sample output - yours may be different.
4

wget -U Mozilla -qO - "http://thepiratebay.org/search/your_querry_here/0/7/0" | grep -o 'http\:\/\/torrents\.thepiratebay\.org\/.*\.torrent'

sairon · 2011-04-15 15:01:16 0
ThePirateBay.org torrent search

usage: tpb searchterm example: tpb the matrix trilogy This searches for torrents from thepiratebay and displays the top results in reverse order, so the 1st result is at the bottom instead of the top -- which is better for command line users
This is sample output - yours may be different.
4

tpb() { wget -U Mozilla -qO - $(echo "http://thepiratebay.org/search/$@/0/7/0" | sed 's/ /\%20/g') | grep -o 'http\:\/\/torrents\.thepiratebay\.org\/.*\.torrent' | tac; }

Bonster · 2011-10-26 12:15:55 0
Download Youtube Playlist

This will download a Youtube playlist and mostly anything http://code.google.com/apis/youtube/2.0/reference.html#Video_Feeds The files will be saved by $id.flv
This is sample output - yours may be different.
3

y=http://www.youtube.com;for i in $(curl -s $f|grep -o "url='$y/watch?v=[^']*'");do d=$(echo $i|sed "s|url\='$y/watch?v=$.*$&.*'|\1|");wget -O $d.flv "$y/get_video.php?video_id=$d&t=$(curl -s "$y/watch?v=$d"|sed -n 's/.* "t": "$[^"]*$",.*/\1/p')";done

matthewbauer · 2009-08-22 21:31:29 1
Go get those photos from a Picasa album
This is sample output - yours may be different.
2

wget 'link of a Picasa WebAlbum' -O - |perl -e'while(<>){while(s/"media":{"content":\[{"url":"(.+?\.JPG)//){print "$1\n"}}' |wget -w1 -i -

aciancone · 2009-09-27 14:36:27 0
Download a new release of a program that you already have very quickly

Zsync is an implementation of rsync over HTTP that allows updating of files from a remote Web server without requiring a full download. For example, if you already have a Debian alpha, beta or RC copy downloaded, zsync can just download the updated bits of the new release of the file from the server. This requires the distributor of the file to have created a zsync build control file (using zsyncmake).
This is sample output - yours may be different.
2

zsync -i existing-file-on-disk.iso http://example.com/new-release.iso.zsync

rkulla · 2010-04-20 07:02:37 0
Download a file securely via a remote SSH server

This command will download $file via server. I've used this when FTP was broken at the office and I needed to download some software packages.
This is sample output - yours may be different.
2

file=ftp://ftp.gimp.org/pub/gimp/v2.6/gimp-2.6.10.tar.bz2; ssh server "wget $file -O -" > $PWD/${file##*/}

michaelmior · 2010-08-02 15:59:45 0
Throttle download speed (at speed x )

Axel --max-speed=x, -s x You can specify a speed (bytes per second) here and Axel will try to keep the average speed around this speed. Useful if you don?t want the program to suck up all of your bandwidth.
This is sample output - yours may be different.
2

axel --max-speed=x

totti · 2013-03-26 16:00:43 0
Put the machine to sleep after the download(wget) is done

[Note: This command needs to be run as root]. If you are downloading something large at night, you can start wget as a normal user and issue the above command as root. When the download is done, the computer will automatically go to sleep. If at any time you feel the computer should not go to sleep automatically(like if you find the download still continuing in the morning), just create an empty file called nosleep in /tmp directory.
This is sample output - yours may be different.
1

while [ -n "`pgrep wget`" ]; do sleep 2 ;done; [ -e "/tmp/nosleep"] || echo mem >/sys/power/state

kamathln · 2009-09-06 05:51:20 0
Download all images from a website in a single folder
This is sample output - yours may be different.
1

wget -nd -r -l 2 -A jpg,jpeg,png,gif http://website-url.com

unixmonkey26318 · 2012-01-27 11:06:50 0
Throttle download speed (at speed x )

Throttle download speed aria2c --max-download-limit=100K file.metalink Throttle upload speed aria2c --max-upload-limit=100K file.torrent
This is sample output - yours may be different.
1

aria2c --max-download-limit=100K file.metalink

totti · 2013-03-26 16:05:52 0

Rip a video for archiving, from any site

Download video files from a bunch of sites (here is a list https://rg3.github.io/youtube-dl/supportedsites.html). The options say: base filename on title, ignores errors and continue partial downloads. Also, stores some metadata into a .json file plz. Paste youtube users and playlists for extra fun. Protip: git-annex loves these files Show Sample Output

youtube-dl -tci --write-info-json "https://www.youtube.com/watch?v=dQw4w9WgXcQ"

wires · 2014-10-13 21:18:34 0

Go get those photos from a Picasa album

Grab the RSS link to the Picasa album. Feed it to the script when its hungry. When its done writing the shopping list, just use wget -c -i wgetlist to get your stuff.
This is sample output - yours may be different.
0

echo 'Enter Picasa album RSS URL:"; read -e feedurl; GET "$feedurl" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' > wgetlist

kamathln · 2009-09-22 10:51:08 0
Download a TiVo Show

Download the last show on your TiVo DVR. Replace $MAK with your MAK see https://www3.tivo.com/tivo-mma/showmakey.do Replace $tivo with your TiVo's IP
This is sample output - yours may be different.
0

curl -s -c /tmp/cookie -k -u tivo:$MAK --digest "$(curl -s -c /tmp/cookie -k -u tivo:$MAK --digest https://$tivo/nowplaying/index.html | sed 's;.*<a href="$[^"]*$">Download MPEG-PS</a>.*;\1;' | sed 's|\&|\&|')" | tivodecode -m $MAK -- - > tivo.mpg

matthewbauer · 2009-09-26 03:00:46 1
Download YouTube music playlist and convert it to mp3 files

umph is parsing video links from Youtube playlists ( http://code.google.com/p/umph/ ) cclive is downloading videos from Youtube ( http://cclive.sourceforge.net/ ) Example: yt-pl2mp3 7AB74822FE7D03E8
This is sample output - yours may be different.
0

yt-pl2mp3() {umph -m 50 $1 | cclive -f mp4_720p; IFS=$(echo -en "\n\b"); for track in $(ls | grep mp4 | awk '{print $0}' | sed -e 's/\.mp4//'); do (ffmpeg -i $track.mp4 -vn -ar 44100 -ac 2 -ab 320 -f mp3 $track.mp3); done; rm -f *.mp4}

sattellite · 2011-03-20 14:43:20 0
Download 40 top funnyjunk Images to the current directory

If your version of curl does not support the --compressed option, use curl -s http://funnyjunk.com | gunzip instead of curl -s --compressed http://funnyjunk.com
This is sample output - yours may be different.
0

curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget

laniner · 2011-07-21 15:57:21 1
Download a set of files that are numbered
This is sample output - yours may be different.
0

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

totti · 2011-08-19 20:06:16 1
Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates. Usage: wgetall mp3 http://example.com/download/
This is sample output - yours may be different.
0

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

peterRepeater · 2011-09-28 09:43:25 0
1 2 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

list files recursively by size

get a directory from one machine to another using tar and ssh

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

BourneShell: Go to previous directory

cd - would return to the previous directory of your cd command. NB: previous dir is always stored in $OLDPWD variable.

use mplayer to watch Apple Movie Trailer instead of quicktime player

http://trailers.apple.com/trailers/ just copy the .mov link and use mplayer to stream

Ctrl+S Ctrl+Q terminal output lock and unlock

These are simple shortcuts to pause and continue terminal output, works in most terminals and screen multiplexers like screen. You can use it to catch something if things change too fast, and scroll with Shift + PgUp PgDown. On linux console ScrollLock can also be used.

see who's using DOM storage a/k/a Web Storage, super cookies

Someone over at Mozilla dot Org probably said, "I know, let's create a super-duper universal replacement for browser cookies that are persistent and even more creepy and then NOT give our browser users the tools they need to monitor, read, block or selectively remove them!" . This will let you see all the DOM object users in all your firefox profiles. Feel free to toss a `| sort -u` on the end to remove dupes. . I highly recommend you treat these as "session cookies" by scripting something that deletes this sqlite database during each firefox start-up. . note: does not do anything for so-called "flash cookies"

Convert A USB Cable Into A Smart Home Gadget

An old USB A/B cable is all you need to make your own Smart Home hardware! Cut off and discard the B-portion of the USB cable. On the A side, connect the RED (+) and WHITE (D-) wires via a 1 kiloohm resistor. $Picture: http://imgur.com/dJGVlAU Now plug the cable into a USB port on your Linux computer. Your hardware is ready! Run the above command after changing variable mysms to your personal email-to-SMS gateway info as required by your cellular service provider. The command uses the amazing usbmon tool (see link below) to detect the cable. For the curious, to view the raw usbmon output, run this command: (Also see the sample output) $usbmon -i usb0 How does it work? When the red and white wires are connected (via the 1 kiloohm resistor) the USB hardwere is tricked into thinking that a new USB device is trying to start up. We then use the usbmon utility to capture the host USB events as it tries to talk to the cable. The expect utility watches the usbmon stream and waits for the disconnect text "-2:128" before sending the SMS message. Finally, the sendmail tool is used to email the SMS message to your smartphone via your cellular provider's SMS-to-email gateway. As a result, when the electrical connection between the red and white wire is interrupted, or the USB cable is unplugged from your computer, you get an SMS notification of the disconnect event on your smartphone. Could this be the cheapest smart home gadget ever? What are YOU going to sense with it? Please let me know in the comments and please don't forget to click it up! $ $Links: $ http://www.linuxcertif.com/man/8/usbmon/ http://en.wikipedia.org/wiki/USB#Pinouts http://imgur.com/dJGVlAU

Generate random valid mac addresses

Ruby version. Also, a perl version: $perl -e 'printf("%.2x.",rand(255))for(1..5);printf("%.2x\n",rand(255))'

MSDOS command to check existance of command and exit batch if failed

This is a command to be used inside of MS-DOS batch files to check existence of commands as preconditions before actual batch processing can be started. If the command is found, batch script continues execution. If not, a message is printed on screen, script then waits for user pressing a key and exits. An error message of the command itself is suppressed for clarity purpose.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged download

Commands tagged download (36) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged download (36)

sorted by