Commands using wget | commandlinefu.com

Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Terminal - Commands using wget - 249 results

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

2012-08-14 22:06:27

User: yosh

Functions: awk grep head ls wget

Up
Down

Random (sfw, 1920x1080) wallpaper from wallbase.cc

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for i in {1..10};do wget $(wget -O- -U "" "http://images.google.com/images?imgsz=xxlarge&hl=en&q=wallpaper+HD&start=$(($RANDOM%900+100))" --quiet | grep -oe 'http://[^"]*\.jpg' | head -1);done

2012-07-26 10:42:13

User: dzup

Functions: grep head wget

Up
Down

download 10 random wallpapers from google

you may want &hl=en for &hl=es for the language

you may want imgsz=xxlarge for imgsz=large or whatever filter

you may want q=apples or whatever

Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

while pgrep wget || sudo shutdown -P now; do sleep 1m; done

2012-05-20 17:49:56

User: kev

Functions: shutdown sleep sudo wget

Tags: wget Shutdown

Up
Down

shutdown if wget exit

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cat urls.txt | wget -i- -T 10 -t 3 --waitretry 1

2012-05-14 06:41:14

User: kev

Functions: cat wget

Tags: wget

Up
Down

download a list of urls

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O - http://www.reddit.com/r/wallpapers.rss | grep -Eo 'http://i.imgur.com[^&]+jpg' | head -1 | xargs wget -O background.jpg

2012-04-25 11:15:26

User: untitaker

Functions: grep head wget xargs

Up
Down

set desktop background to highest-rated image from Reddit /r/wallpapers

Doesn't depend on curl and doesn't use thumbnails as wallpaper (which has the unfortunate effect of only allowing imgur links)

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -S --spider http://osswin.sourceforge.net/ 2>&1 | grep Mod

2012-04-18 03:43:33

User: dmmst19

Functions: grep wget

Tags: wget headers modified

Up
Down

Find out how old a web page is

I used to use the Firefox "View page info" feature a lot to determine how stale the web page I was looking at was. Now that I use mostly Chrome I miss that feature, so here is a command line alternative using wget. The -S says to display the server response, the --spider says to not download any files/pages, just fetch the header. The output goes to stderr, so to grep it you use 2>&1 to combine the stderr stream with stdout, the pipe that to grep for Last-Modified.

You can use curl instead if you have it installed, like this:

curl --head -s http://osswin.sourceforge.net | grep Mod

wget -q ip.nu && cat index.html

2012-03-23 03:14:37

User: VictorBjelkholm

Functions: cat wget

-1

Up
Down

View external IP

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -m -k -K -E http://url/of/web/site

2012-03-19 20:22:05

User: joedistro

Functions: wget

Up
Down

Download an Entire website with wget

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -qO - http://whatismyip.org | tail

2012-03-17 10:13:05

User: Flolagale

Functions: wget

Up
Down

What is my public IP address

Uses wget standard GNU utility. Prints only your ip.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for i in $(seq 1 `curl http://megatokyo.com 2>/dev/null|grep current|cut -f6 -d\"`);do wget http://megatokyo.com/`curl http://megatokyo.com/strip/${i} 2>/dev/null|grep src=\"strips\/|cut -f4 -d\"`;done

2012-03-04 22:52:36

User: akira88

Functions: cut grep seq wget

Tags: wget comic

Up
Down

Download all MegaTokyo strips

A simple script for download all the MegaTokyo strips from the first to the last one

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -qO- -U '' 'google.com/search?q=weather' | grep -oP '(-)?\d{1,3}\xB0[FC]'

2012-02-28 22:27:38

User: slaufer

Functions: grep wget

-1

Up
Down

Weather

Grabs the current weather in your area (or their best guess of your area). Change the query to your zip code/location (e.g. google.com/search?q=weather+jakarta,+india) to get weather somewhere else. change google.com to google.ca or google.co.uk for metric.

wget http://icanhazip.com -qO-

2012-02-17 15:38:51

User: sreimann

Functions: wget

Tags: wget ip address

Up
Down

Get your outgoing IP address

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -nd -r -l 2 -A jpg,jpeg,png,gif http://website-url.com

2012-01-27 11:06:50

User: unixmonkey26318

Functions: wget

Tags: wget download images

Up
Down

Download all images from a website in a single folder

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -U Mozilla http://example.com/foo.tar.gz

2012-01-18 05:47:14

User: sugy

Functions: wget

-11

Up
Down

wget - 403 Forbidden Error

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for fn in xkcd*.png xkcd*.jpg; do echo $fn; read xw xh <<<$(identify -format '%w %h' $fn); nn="$(echo $fn | sed 's/xkcd-$[^-]\+$-.*/\1/')"; wget -q -O xkcd-${nn}.json http://xkcd.com/$nn/info.0.json; tt="$(sed 's/.*"title": "$[^"]\+$",.*/\1/' ...

2012-01-06 20:26:11

User: fpunktk

Functions: echo read wget

Tags: bash ImageMagick sed identify convert xkcd

-2

Up
Down

add title and alt-text to your collection of xkcd comics

full command:

for fn in xkcd*.png xkcd*.jpg; do; echo $fn; read xw xh <<<$(identify -format '%w %h' $fn); nn="$(echo $fn | sed 's/xkcd-\([0-9]\+\)-.*/\1/')"; wget -q -O xkcd-${nn}.json http://xkcd.com/$nn/info.0.json; tt="$(sed 's/.*"title": "\([^"]*\)", .*/\1/' xkcd-${nn}.json)"; at="$(sed 's/.*alt": "\(.*\)", .*/\1/' xkcd-${nn}.json)"; convert -background white -fill black -font /usr/share/fonts/truetype/freefont/FreeSansBold.ttf -pointsize 26 -size ${xw}x -gravity Center caption:"$tt" tt.png; convert -background '#FFF9BD' -border 1x1 -bordercolor black -fill black -font /usr/share/fonts/truetype/freefont/FreeSans.ttf -pointsize 16 -size $(($xw - 2))x -gravity Center caption:"$at" at.png; th=$(identify -format '%h' tt.png); ah=$(identify -format '%h' at.png); convert -size ${xw}x$(($xh+$th+$ah+5)) "xc:white" tt.png -geometry +0+0 -composite $fn -geometry +0+$th -composite at.png -geometry +0+$(($th+$xh+5)) -composite ${fn%\.*}_cmp.png; echo -e "$fn $nn $xw $xh $th $ah \n$tt \n$at\n"; done

this assumes that all comics are saved as xkcd-[number]-[title].{png|jpg}.

it will then download the title and alt-text, create pictures from them, and put everything together in a new png-file.

it's not perfect, but it worked for nearly all my comics.

it uses the xkcd-json-interface.

though it's poorly written, it doesn't completely break on http://xkcd.com/859/

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O chart.png 'http://chart.googleapis.com/chart?chs=250x100&chd=t:60,40&cht=p3&chl=Hello|World'

2011-12-10 18:03:16

User: kev

Functions: wget

Tags: google api

Up
Down

google chart api

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget ifconfig.me/ip -q -O -

2011-11-30 08:30:35

User: DamirX

Functions: wget

Tags: Network curl ip address

-1

Up
Down

Get your external IP address

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

url="put_url_here";audio=$(youtube-dl -s -e $url);wget -q -O - `youtube-dl -g $url`| ffmpeg -i - -f mp3 -vn -acodec libmp3lame - > "$audio.mp3"

2011-11-15 19:09:52

User: o0110o

Functions: wget

Tags: youtube mp3

Up
Down

Convert Youtube videos to MP3

Make your own MP3s from Youtube videos.

wget -A mp3,mpg,mpeg,avi -r -l 3 http://www.site.com/

2011-11-09 10:06:07

User: kev

Functions: wget

Tags: wget

Up
Down

recursively walk down no more than three levels and grab any file with an extension of mp3, mpg, mpeg, or avi

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

tpb() { wget -U Mozilla -qO - $(echo "http://thepiratebay.org/search/$@/0/7/0" | sed 's/ /\%20/g') | grep -o 'http\:\/\/torrents\.thepiratebay\.org\/.*\.torrent' | tac; }

2011-10-26 12:15:55

User: Bonster

Functions: echo grep sed wget

Tags: bash download api url torrent torrents pirate thepiratebay piratebay ash

Up
Down

ThePirateBay.org torrent search

usage: tpb searchterm

example: tpb the matrix trilogy

This searches for torrents from thepiratebay and displays the top results in reverse order,

so the 1st result is at the bottom instead of the top -- which is better for command line users

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

geoip() { wget -qO - http://freegeoip.net/xml/$1 | sed '3,12!d;s/<//g;s/>/: /g;s/\/.*//g' ; }

2011-10-25 21:07:08

User: vando

Functions: sed wget

-1

Up
Down

geoip information

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -b http://dl.google.com/android/android-sdk_r14-linux.tgz

2011-10-19 21:55:25

User: zlemini

Functions: wget

Up
Down

background a wget download

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

expandurl() { wget -S $1 2>&1 | grep ^Location; }

2011-10-18 18:50:54

User: atoponce

Functions: grep wget

Tags: wget

Up
Down

Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from:

expandurl http://t.co/LDWqmtDM

wget -O - -q http://whatismyip.org/

2011-10-15 11:36:56

User: ztank1013

Functions: wget

-5

Up
Down

Get your external IP address

This just output your external IP, no extra characters at the end of line.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -qO - --post-data "data[Row][cripted]=1cb251ec0d568de6a929b520c4aed8d1" http://md5-decrypter.com/ | grep -A1 "Decrypted text" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

2011-10-13 03:48:54

User: samhagin

Functions: cut grep sed tail wget

Tags: md5

Up
Down

Decrypt MD5

Decrypt MD5 , replace 1cb251ec0d568de6a929b520c4aed8d1 with the MD5 string you want to decrypt

< 1 2 3 4 5 > Last ›