Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Universal configuration monitoring and system of record for IT.
Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

May 19, 2015 - A Look At The New Commandlinefu
I've put together a short writeup on what kind of newness you can expect from the next iteration of clfu. Check it out here.
March 2, 2015 - New Management
I'm Jon, I'll be maintaining and improving clfu. Thanks to David for building such a great resource!
Hide

Top Tags


awk, bash, curl, find, grep, Linux, sed
Hide

Functions

Hide

Credits

Maintained by Jon H.

Site originally by David Winterbottom (user root).

Psst. Open beta.

Wow, didn't really expect you to read this far down. The latest iteration of the site is in open beta. It's a gentle open beta-- not in prime-time just yet. It's being hosted over at UpGuard (link) and you are more than welcome to give it a shot. Couple things:

  • » The open beta is running a copy of the database that will not carry over to the final version. Don't post anything you don't mind losing.
  • » If you wish to use your user account, you will probably need to reset your password.
Your feedback is appreciated via the form on the beta page. Thanks! -Jon & CLFU Team

Commands using wget from sorted by
Terminal - Commands using wget - 262 results
wget randomfunfacts.com -O - 2>/dev/null | grep \<strong\> | sed "s;^.*<i>\(.*\)</i>.*$;\1;"
2010-03-30 23:49:30
User: tali713
Functions: grep sed wget
Tags: Shell programming bash Linux sed wget grep unix shell redirection pipes cygwin bsd
13
Up
Down
Working random fact generator

Though without infinite time and knowledge of how the site will be designed in the future this may stop working, it still will serve as a simple straight forward starting point.

This uses the observation that the only item marked as strong on the page is the single logical line that includes the italicized fact.

If future revisions of the page show failure, or intermittent failure, one may simply alter the above to read.

wget randomfunfacts.com -O - 2>/dev/null | tee lastfact | grep \<strong\> | sed "s;^.*<i>\(.*\)</i>.*$;\1;"

The file lastfact, can then be examined whenever the command fails.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
trickle -d 60 wget http://very.big/file
2010-03-29 06:55:30
User: point_to_null
Functions: wget
Tags: Network unix download speed
7
Up
Down
Limit bandwidth usage by any program

Trickle is a voluntary, cooperative bandwidth shaper. it works entirely in userland and is very easy to use.

The most simple application is to limit the bandwidth usage of programs.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -r -np -nd -A.pdf --user *** --password *** http://www.domain.tld/courses/***/download/
2010-03-28 09:26:49
User: saerdnaer
Functions: wget
1
Up
Down
Download all PDFs from an authenificated website

Replace *** with the appropiate values

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
if [ "$(ping -q -c1 google.com)" ];then wget -mnd -q http://www.google.com/intl/en_ALL/images/logo.gif ;fi
2010-03-23 04:15:03
User: alf
Functions: wget
Tags: bash Linux ping wget if
-1
Up
Down
Use ping to test if a server is up

Bash scrip to test if a server is up, you can use this before wget'ing a file to make sure a blank one isn't downloaded.

Comments (74) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
currency_convert() { wget -qO- "http://www.google.com/finance/converter?a=$1&from=$2&to=$3&hl=es" | sed '/res/!d;s/<[^>]*>//g'; }
2010-03-22 13:41:39
User: vinodvm
Functions: sed wget
3
Up
Down
Currency Conversion

eg:

currency_convert 1 usd inr

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for i in be bg cz de es fi fr hu it lv lu at pl pt ro sk si ; do echo -n "$i " ; wget -q -O - http://www.expansys.$i/d.aspx?i=196165 | grep price | sed "s/.*<p id='price'><strong>&euro; \([0-9]*[,.][0-9]*\).*/\1/g"; done
2010-03-18 15:13:20
User: betsubetsu
Functions: at bg echo grep sed wget
Tags: htd desire expansys
2
Up
Down
Compare prices in euro of the HTC Desire on all the european websites of Expansys.

You think Expansys in all these countries will sell the HTC Desire for the same price? Well, you'll be surprised. Most of them will be sold at 499.99 EUR but the cheapest can be found in Germany and the most expensive, in Belgium.

Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
pronounce(){ wget -qO- $(wget -qO- "http://dictionary.reference.com/browse/$@" | grep 'soundUrl' | head -n 1 | sed 's|.*soundUrl=\([^&]*\)&.*|\1|' | sed 's/%3A/:/g;s/%2F/\//g') | mpg123 -; }
2010-03-13 04:23:56
User: matthewbauer
Functions: grep head mpg123 sed wget
Tags: audio sed wget eval pronounce aplay English dictionary dictionary.com
13
Up
Down
Pronounce an English word using Dictionary.com

This one uses dictionary.com

Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cmd=$( wget -qO- "http://ajax.googleapis.com/ajax/services/language/translate?v=1.0&q=$1&langpair=$2|${3:-en}" | sed 's/.*"translatedText":"\([^"]*\)".*}/\1\n/'; ); echo "$cmd"
2010-03-13 01:09:00
User: dtolj
Functions: sed wget
Tags: google translate
2
Up
Down
Google Translate
translate <phrase> <source-language> <output-language>

works from command line

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
pronounce(){ wget -qO- $(wget -qO- "http://www.m-w.com/dictionary/$@" | grep 'return au' | sed -r "s|.*return au\('([^']*)', '([^'])[^']*'\).*|http://cougar.eb.com/soundc11/\2/\1|") | aplay -q; }
2010-03-12 17:44:16
User: matthewbauer
Functions: aplay grep sed wget
Tags: audio sed wget eval pronounce merriam-webster aplay English
5
Up
Down
Pronounce an English word using Merriam-Webster.com

The original was a little bit too complicated for me. This one does not use any variables.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cmd=$(wget -qO- "http://www.m-w.com/dictionary/$(echo "$@"|tr '[A-Z]' '[a-z]')" | sed -rn "s#return au\('([^']+?)', '([^'])[^']*'\);.*#\nwget -qO- http://cougar.eb.com/soundc11/\2/\1 | aplay -q#; s/[^\n]*\n//p"); [ "$cmd" ] && eval "$cmd" || exit 1
2010-03-12 13:56:41
User: hackerb9
Functions: eval exit sed wget
Tags: audio sed wget eval pronounce merriam-webster aplay English
3
Up
Down
Pronounce an English word using Merriam-Webster.com

Looks up a word on merriam-webster.com, does a screen scrape for the FIRST audio pronunciation and plays it.

USAGE: Put this one-liner into a shell script (e.g., ~/bin/pronounce) and run it from the command line giving it the word to say:

pronounce lek

If the word isn't found in merriam-webster, no audio is played and the script returns an error value. However, M-W is a fairly complete dictionary (better than howjsay.com which won't let you hear how to pronounce naughty words).

ASSUMPTIONS: GNU's sed (which supports -r for extended regular expressions) and Linux's aplay. Aplay can be replaced by any program that can play .WAV files from stdin.

KNOWN BUGS: only the FIRST pronunciation is played, which is problematic if you wanted a particular form (plural, adjectival, etc) of the word. For example, if you run this:

pronounce onomatopoetic

you'll hear a voice saying "onomatopoeia".

Playing the correct form of the word is possible, but doing so might make the screen scraper even more fragile than it already is. (The slightest change to the format of m-w.com could break it).

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
translate(){ wget -qO- "http://ajax.googleapis.com/ajax/services/language/translate?v=1.0&q=$1&langpair=$2|${3:-en}" | sed 's/.*"translatedText":"\([^"]*\)".*}/\1\n/'; }
2010-03-08 03:15:48
User: matthewbauer
Functions: sed wget
Tags: google translate
65
Up
Down
Google Translate

Usage:

translate <phrase> <source-language> <output-language>

Example:

translate hello en es

See this for a list of language codes:

http://en.wikipedia.org/wiki/List_of_ISO_639-1_codes

Show sample output | Comments (14) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -erobots=off --user-agent="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008092416 Firefox/3.0.3" -H -r -l2 --max-redirect=1 -w 5 --random-wait -PmyBooksFolder -nd --no-parent -A.pdf http://URL
2010-03-01 20:22:44
User: unixmonkey8504
Functions: wget
8
Up
Down
Download free e-books

Mask the user agent as firefox, recursively download 2 levels deep from a span host with a maximum of 1 redirection, use random wait time and dump all pdf files to myBooksFolder without creating any other directories. Host will have no way of knowing that this is a grabber script.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -r --no-parent http://codeigniter.com/user_guide/ ; mv codeigniter.com/user_guide/* . ; rm -rf codeigniter.com
2010-03-01 02:37:26
User: jimthunderbird
Functions: mv rm wget
-1
Up
Down
Download all files under http://codeigniter.com/user_guide/ to the current directory

I constantly need to work on my local computer, thus I need a way to download the codeigniter user guide, this is the wget way I figured.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -qO - http://example.com/path/to/blah.tar.gz | tar xzf -
2010-02-15 04:00:29
User: TuxOtaku
Functions: tar wget
17
Up
Down
download and unpack tarball without leaving it sitting on your hard drive
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -q -U busybox -O- "http://www.google.com/search?ie=UTF8&q=define%3A$1" | tr '<' '\n' | sed -n 's/^li>\(.*\)/\1\n/p'
2010-02-01 13:01:47
User: hackerb9
Functions: sed tr wget
Tags: sed wget tr google busybox
0
Up
Down
Define words with google. (busybox version)

This is a minimalistic version of the ubiquitious Google definition screen scraper. This version was designed not only to run fast, but to work using BusyBox. BusyBox is a collection of basic Unix tools that have been compiled into a single binary to save space on tiny installations of Unix. For example, although my phone doesn't have perl or the GNU utilities, it does have BusyBox's stripped down versions of wget, tr, and sed. It turns out that those tools suffice for many tasks.

Known Bugs: This script does not handle HTML entities at all. I don't think there's an easy way to do that within BusyBox, but I'd love to see it if someone could do it. Also, this script can only define a single word, not phrases. (Well, you could if you typed in %20, but that'd be gross.) Lastly, this script does not show the URL where definitions were found. Given the randomness of the Net, that last bit of information is often key.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -rc -A.flac --tries=5 http://archive.org/the/url/of/the/album
2010-01-20 07:36:25
User: meunierd
Functions: wget
Tags: music internet archive
0
Up
Down
Download full FLAC albums from archive.org

The only zipped version of an album available for download is the lossy mp3 version. To download lossless files, because of their size, you must download them individually. This command scrapes the page for all the FLAC (or also SHN) files.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wtzc () { wget "$@"; foo=`echo "$@" | sed 's:.*/::'`; tar xzvf $foo; blah=`echo $foo | sed 's:,*/::'`; bar=`echo $blah | sed -e 's/\(.*\)\..*/\1/' -e 's/\(.*\)\..*/\1/'`; cd $bar; ls; }
2010-01-17 11:25:47
User: oshazard
Functions: cd sed tar wget
-1
Up
Down
wget, tar xzvf, cd, ls

Combines a few repetitive tasks when compiling source code. Especially useful when a hypen in a file-name breaks tab completion.

1.) wget source.tar.gz

2.) tar xzvf source.tar.gz

3.) cd source

4.) ls

From there you can run ./configure, make and etc.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -r -l1 -np -nd http://yoururl.com/yourfolder/
2010-01-14 16:22:44
User: tanj
Functions: wget
1
Up
Down
download the contents of a remote folder in the current local folder
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget http://domain.com/file{1..100}
2010-01-12 14:28:04
User: wincus
Functions: wget
Tags: bash bash tricks
5
Up
Down
download file1 file2 file3 file4 .... file 100
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -H -r ?level=1 -k -p http://www.domain.com/folder/
2009-12-27 05:23:27
User: svnlabs
Functions: wget
-2
Up
Down
wget ? server to server files transfer

wget ? server to server files transfer

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -O - http://example.com/a.gz | tar xz
2009-12-20 02:38:12
User: pornel
Functions: tar wget
4
Up
Down
Extract tarball from internet without local saving

Use `tar xj` for bzip2 archives.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -q -O - http://someonewhocares.org/hosts/ | grep ^127 >> /etc/hosts
2009-12-14 17:11:16
User: torrid
Functions: grep wget
7
Up
Down
Block the 6700 worst spamhosts

The above url contains over 6700 of the common ad websites. The command just pastes these into your /etc/hosts.

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -qO - http://cfaj.freeshell.org/ipaddr.cgi
2009-12-10 04:34:57
User: cfajohnson
Functions: wget
-3
Up
Down
Get your public ip
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -q http://dynamic.xkcd.com/comic/random/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*\(http:.*\)" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'
2009-12-09 13:41:25
User: laugg
Functions: awk sed wget
Tags: sed awk wget comic
0
Up
Down
View a random xkcd comic

Only need to install Image Magick package.

Display a xkcd comic with its title and save it in /tmp directory

If you prefer to view the newest xkcd, use this command:

wget -q http://xkcd.com/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*\(http:.*\)" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'
Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -O - -q http://www.azlyrics.com/lyrics/abba/takeachanceonme.html | sed -e 's/[cC]hance/dump/g' > ~/tdom.htm && firefox ~/tdom.htm
2009-12-04 22:56:00
User: tighe
Functions: sed wget
0
Up
Down
Make ABBA better (requires firefox)

ABBA would be more entertaining if they sang this.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate