Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.


Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Universal configuration monitoring and system of record for IT.
Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

May 19, 2015 - A Look At The New Commandlinefu
I've put together a short writeup on what kind of newness you can expect from the next iteration of clfu. Check it out here.
March 2, 2015 - New Management
I'm Jon, I'll be maintaining and improving clfu. Thanks to David for building such a great resource!
Hide

Top Tags

Hide

Functions

Psst. Open beta.

Wow, didn't really expect you to read this far down. The latest iteration of the site is in open beta. It's a gentle open beta-- not in prime-time just yet. It's being hosted over at UpGuard (link) and you are more than welcome to give it a shot. Couple things:

  • » The open beta is running a copy of the database that will not carry over to the final version. Don't post anything you don't mind losing.
  • » If you wish to use your user account, you will probably need to reset your password.
Your feedback is appreciated via the form on the beta page. Thanks! -Jon & CLFU Team

Download an entire website

Terminal - Download an entire website
wget --random-wait -r -p -e robots=off -U mozilla http://www.example.com
2009-02-17 22:53:07
User: starchox
Functions: wget
173
Download an entire website

-p parameter tells wget to include all files, including images.

-e robots=off you don't want wget to obey by the robots.txt file

-U mozilla as your browsers identity.

--random-wait to let wget chose a random number of seconds to wait, avoid get into black list.

Other Useful wget Parameters:

--limit-rate=20k limits the rate at which it downloads files.

-b continues wget after logging out.

-o $HOME/wget_log.txt logs the output

Alternatives

There are 2 alternatives - vote for the best!

Terminal - Alternatives

Know a better way?

If you can do better, submit your command here.

What others think

I think some builds of wget have the -m (mirror) option available as well.

Comment by joem86 407 weeks ago

The given command does not download an entire web site. It downloads a single page, plus any images and such on that page.

For this functionality, the '-r' is not necessary, and the random wait generally isn't either.

Comment by ToyKeeper 387 weeks and 5 days ago

Ignore previous comment. Apparently the default recursion depth is now 5, which is often enough to download entire sites. However, if you want to be sure, add a '-l 0' to remove the recursion depth limit.

Comment by ToyKeeper 387 weeks and 4 days ago

From the man page, useful for offline browsing:

-k

--convert-links

After the download is complete, convert the links in the document to make them suitable for local viewing. This affects not only the visible hyperlinks, but any part of the document that links to external content,

such as embedded images, links to style sheets, hyperlinks to non-HTML content, etc.

Comment by piccobello 281 weeks and 1 day ago

-p is not necessary if you're using -r

-K will keep copies of original files before modifying links with -k

-N for timestamps: useful for refreshing a mirror, only downloading new stuff

Comment by johnraff 264 weeks ago

http://www.longchamp-solde.fr

http://www.sac-louisvuittonpascher.fr

http://www.swarovski.in.net

http://www.truereligionjeansoutlet.com

http://www.tomsoutlet-stores.com

http://www.timberlandboots.me.uk

http://www.christianlouboutinuk.org.uk

http://www.michaelkorsusa.us

http://www.saclongchamp-pliage.fr

http://www.jordanshoes.us.com

http://www.airforce1.us.com

http://www.longchampoutlet.name

http://www.rolexwatches.in.net

http://www.nikeairmax90.me.uk

http://www.michaelkorsfactory-outlet.us.com

http://www.coachoutletcanada.com.co

http://www.christianlouboutinoutlet.me.uk

http://www.truereligionoutlet-store.us.com

http://www.nikerosherunwomen.co.uk

http://www.nike-mercurial.net

http://www.hermesbirkin.org

http://www.michaelkorsoutletonlinstore.us.com

http://www.hermesbelts.us

http://www.nikeairmax90.org.uk

http://www.fitflop.in.net

http://www.michaelkorsoutletonline.in.net

http://www.mcm.in.net

http://www.michaelkorsoutlets.org.uk

http://www.lacostepoloshirts.cc

http://www.truereligionjeanscanada.com

http://www.thomassabos.co.uk

http://www.coachoutletstore.com.co

http://www.ralphlaurenoutlet.in.net

http://www.louisvuittonus.us.com

http://www.truereligionjeansoutlets.us.com

http://www.louisvuitton.in.net

http://www.coachoutletstores.com.co

http://www.cheapmichaelkorshandbag.in.net

http://www.cheapnfljerseys.org

http://www.outletswarovski.co.uk

http://www.toms.us.com

http://www.louboutinpas-cher.fr

http://www.swarovskicrystal.me.uk

http://www.hermesoutletstore.us.com

http://www.kobebryantshoes.in.net

http://www.louisvuittonoutletstore.name

http://www.cheapmlbjerseys.us.com

http://www.nike-airhuarache.co.uk

http://www.truereligion-jean.us.com

http://www.iphone-cases.name

http://www.tiffany-outlet.us.com

http://www.pandorajewelryoutlet.us.com

http://www.tiffanyjewellery-outlet.co.uk

http://www.burberryonlineoutlet.in.net

http://www.reeboktrainers.org.uk

http://www.christianlouboutinonline.us.com

http://www.cheap-nfljersey.us.com

http://www.nikeairmax90.co.uk

http://www.pandora.eu.com

http://www.mont-blancpens.com.co

http://www.nbajerseys-wholesale.us.com

http://www.raybansunglassesonline.us.com

http://www.nfljerseys-wholesale.us.com

http://www.louisvuittonhandbagsoutlet.co.uk

http://www.michaelkorsfactoryoutlets.in.net

http://www.michaelkorsoutlet-store.us.com

http://www.poloralphlaurenshirts.us.com

http://www.michaelkors-outlets.us.com

http://www.michaelkorshandbagsale.us.com

http://www.nhljerseys-wholesale.us.com

http://www.rolexwatches-uk.co.uk

http://www.cheap-snapbacks.us.com

http://www.michaelkorsclearance.in.net

http://www.cheapmlbjerseys.net

http://www.air-jordanshoes.us.com

http://michaelkors.outletonlinestores.us.com

http://www.adidasoutletstore.in.net

http://www.ralphlauren-pascher.fr

http://www.discountmichaelkorshandbags.in.net

http://www.juicycoutureoutlet.net

http://www.louisvuittonoutlet.in.net

http://www.cheapsoccerjersey.net

http://mulberryoutlet.outlet-store.co.uk

http://michaelkors.outletstoreonline.us.com

http://www.lebronjamesshoes.in.net

http://www.beats-headphones.in.net

http://www.michaelkorshandbagsoutletstore.us.com

http://www.niketnpas-cher.fr

http://www.michaelkorssale.in.net

http://www.swarovskicrystal.us.com

http://www.nikeairmaxshoess.co.uk

http://www.timberlandboots.name

http://www.basketballshoes.us.com

http://www.soccerjerseys.us.com

http://www.adidas-wings.in.net

http://www.pradaoutlet.us

http://www.michaelkorsoutletonlinestores.us.com

http://www.lebronjames.us.com

http://www.michaelkorsfactoryoutlet.us.org

http://www.futbol-baratas.com

http://www.nikeairhuarache.org.uk

http://www.michaelkorshandbagsclearances.us.com

http://www.hermesbags.co.uk

http://www.raybansun-glasses.in.net

http://www.linksoflondons.co.uk

http://www.michaelkorsoutletclearance.us.com

http://www.cheap-jordanshoes.us.com

http://www.michaelkorswallet.net

http://www.airmax2015.in.net

http://www.chaussurelouboutin.fr

http://www.longchamppas-cher.fr

http://www.oakleysunglassess-outlet.us.com

http://www.pololacostepascher.fr

http://www.nikeblazerpas-cher.fr

http://www.kobeshoes.us

http://www.pradahandbagsoutlet.co.uk

http://www.asicsisrael.com

http://www.michaelkorsoutletcanada.in.net

http://www.birkenstock.us.com

http://www.michaelkorswholesale.us.com

http://www.ralphlaurenpolo.it

http://www.outletmulberry.co.uk

http://www.raybansunglass.com.au

http://www.longchamppliage.fr

http://www.michaelkorsoutlet.org.uk

http://www.pradashoes.us

http://www.michaelkorshandbags.in.net

http://www.mbtshoesoutlet.us.com

http://www.louisvuittonbag.us.com

http://www.raybansunglass.us.com

http://www.beatsbydrdre-headphones.us.com

http://www.calvinklein.in.net

http://www.michaelkorsbags.uk

http://www.adidastrainers.me.uk

http://www.cheapfootballshirt.org.uk

http://www.nikeairforce1.fr

http://www.jordan-pascher.fr

http://www.cheapjordan-shoes.us.com

http://www.herveleger.us.com

http://www.reebokoutletstore.us.com

http://www.michaelkorsoutletusa.net

http://www.louisvuittonhandbag.us

http://www.longchamphandbag.us.com

http://www.jordan-shoes.us.com

http://www.michaelkorsonlinesale.us.com

http://www.louisvuittonhandbags.org.uk

20160323caihuali

Comment by xiaozhengm 37 weeks and 1 day ago

It's great, I have learned many useful things, to apply to my blog. You just like me!

https://plus.google.com/u/0/107023740377478224643/posts

https://twitter.com/baixarmusicas8

https://baixarmusicas8.wordpress.com/

https://sites.google.com/site/baixarmusicasgratis8/

http://baixarmusicas8.blogspot.com/

https://www.pinterest.com/baixarmusicas8/

https://www.flickr.com/photos/baixarmusicas8

http://imgfave.com/baixarmusicas8

http://baixarmusicas.deviantart.com/

http://baixarmusicas09.weebly.com/

https://myspace.com/baixar.musicas

http://baixarmusicas08.mywapblog.com/

https://www.diigo.com/user/baixarmusicas08

https://storify.com/baixarmusicas

http://hangngothi123.wixsite.com/baixarmusicas

http://baixarmusicas.over-blog.com/

http://www.scoop.it/u/baixar-musicas-1

http://baixarmusicas08.blog.fc2.com/

https://www.reddit.com/user/baixarmusicas/

http://baixarmusicas08.blogolink.com/

https://imgur.com/user/baixarmusicas08

http://www.slideshare.net/baixarmusicas08

http://baixarmusicas08.pixnet.net/blog

http://baixarmusicas08.kinja.com/

http://www.purevolume.com/baixarmusicas

http://weheartit.com/baixarmusicas

http://baixarmusicas08.yolasite.com/

http://www.baixarmusicas08.estranky.cz/

Comment by hoami 16 weeks and 1 day ago

It's great, I have learned many useful things, to apply to my blog. You just like me!

https://plus.google.com/u/0/114255537570764200580/posts

https://twitter.com/baixarsnapchat

https://baixarsnapchat.wordpress.com/

https://sites.google.com/site/baixarsnapchat8/

http://baixarsnapchat08.blogspot.com/

https://www.pinterest.com/baixarsnapchat/

https://www.flickr.com/photos/baixarsnapchat/

http://imgfave.com/baixarsnapchat08

http://baixarsnapchat.deviantart.com/

http://baixarsnapchat.weebly.com/

https://myspace.com/baixarsnapchat

http://baixarsnapchat.mywapblog.com/

https://www.diigo.com/user/baixarsnapchat

https://storify.com/baixarsnapchat

http://hangngothi124.wixsite.com/baixarsnapchat

http://baixarsnapchat.over-blog.com/

http://www.scoop.it/u/baixar-snapchat

http://baixarsnapchat.blog.fc2.com/

https://www.reddit.com/user/baixarsnapchat/

http://baixarsnapchat.blogolink.com/

http://imgur.com/user/baixarsnapchat

http://www.slideshare.net/baixarsnapchat

http://baixarsnapchat.pixnet.net/blog

https://kinja.com/baixarsnapchat

http://www.purevolume.com/baixarsnapchat

http://weheartit.com/baixarsnapchat

http://snapchat08.yolasite.com/

http://www.baixarsnapchat.estranky.cz

Comment by hoami 16 weeks and 1 day ago

http://www.ultraboostuncaged.us/ Ultra Boost Uncaged

http://www.outlettoms.us/ Toms Outlet

http://www.cheap--jordanshoes.us.com/ Jordan Shoes

http://www.rayban-outlets.com/ Ray Ban Outlet

http://www.oakley-outlet.org/ Oakley Outlet

http://www.longchampoutletstore.org/ Longchamp Outlet Store

http://www.yeezy.com.co/ Yeezy

http://www.kedsshoesforwomen.com/ Keds Shoes For Women

http://www.nikeoutlet.org.uk/ Nike UK

http://www.jordan4.us/ Jordan 4

http://www.nikehuarache.us/ Nike Huarache

http://www.adidasnmd.us.com/ Adidas NMD Women

http://www.nikeoutletfactorystore.com/ Nike Factory Outlet

http://www.nikeflyknit.org/ Nike Flyknit

http://www.mlb-jerseys.us/ MLB Jerseys

http://www.outletrayban.us/ Ray Ban Outlet

http://www.jordan12.us/ Jordan 12

http://www.ray-banoutlet.net/ Ray Bans Outlet

http://www.yeezyboost350.us.com/ Adidas Yeezy

http://www.ray-banoutlet.site/ Ray Ban Outlet Online

http://www.ralphlaurenoutletstoreonline.org/ Ralph Lauren Outlet Online

http://www.air-max2015.org/ Nike Air Max 2015

http://www.underarmouroutlet.us.com/ Under Armour Outlet

http://www.yeezyboost350.us.com/ Yeezy Boost 350

http://www.nikeoutletsstore.com/ Nike Outlet Store

http://www.longchampbags.us.com/ Longchamp Bags

http://www.nikerosherun.us.com/ Roshe Run

http://www.nikeairmax.us/ Air Max

http://www.airmax2016.us.com/ Air Max 2016

http://www.timberland-boots.me.uk/ Timberland UK

http://www.yeezy-shoes.us.com/ Yeezy

http://www.nfljerseys.us/ NFL Jersey

http://www.poloralphlaurenoutlets.us.com/ Polo Ralph Lauren Outlet

Comment by rboutlet1 12 weeks and 3 days ago

Your point of view

You must be signed in to comment.