Commands using wget | commandlinefu.com

Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Terminal - Commands using wget - 237 results

wget `lynx --dump http://xkcd.com/|grep png`

2009-12-03 23:10:22

User: metalx1000

Functions: grep wget

Tags: bash wget lynx curl function xkcd comic webcomic

Up
Down

View the newest xkcd comic.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -t inf -k -r -l 3 -p -m http://apod.nasa.gov/apod/archivepix.html

2009-12-03 10:27:57

User: ninadsp

Functions: wget

Up
Down

Mirror the NASA Astronomy Picture of the Day Archive

Mirror the entire NASA Astronomy Picture of the Day archive, all the way from 1995. The archive is close to 2.5 GB, with lots of files, so give it some time. The logs can be redirected to a file using '-o somefile'. You might also want to try '-nH' and the '--cut-dirs' options

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

xkcd(){ wget -qO- http://xkcd.com/|tee >(feh $(grep -Po '(?<=")http://imgs[^/]+/comics/[^"]+\.\w{3}'))|grep -Po '(?<=(\w{3})" title=").*(?=" alt)';}

2009-11-27 09:11:47

User: eightmillion

Functions: grep tee wget

Tags: bash curl function xkcd comic webcomic

Up
Down

View the newest xkcd comic.

This function displays the latest comic from xkcd.com. One of the best things about xkcd is the title text when you hover over the comic, so this function also displays that after you close the comic.

To get a random xkcd comic, I also use the following:

xkcdrandom(){ wget -qO- dynamic.xkcd.com/comic/random|tee >(feh $(grep -Po '(?<=")http://imgs[^/]+/comics/[^"]+\.\w{3}'))|grep -Po '(?<=(\w{3})" title=").*(?=" alt)';}

Comments (11) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

while true; do wget -r -l1 --no-clobber -A.txt http://911.wikileaks.org/files/index.html; done; cat *.txt | grep pass

2009-11-26 23:38:44

User: Cowboy

Functions: cat grep wget

-5

Up
Down

Passwords from 9/11 tragedy pager intercepts (Yeah! Plain text! From wikileaks.net)

http://www.reddit.com/r/reddit.com/comments/a7xpt/conspiracy_theories_commence_wikileaks_to_release/

wget -qO - http://www.sputnick-area.net/ip;echo

2009-11-20 23:10:31

User: cfajohnson

Functions: wget

Tags: Network IP external

Up
Down

Get your external IP address

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -q -O - `youtube-dl -b -g $url`| ffmpeg -i - -f mp3 -vn -acodec libmp3lame -| mpg123 -

2009-11-07 13:45:13

User: torrid

Functions: mpg123 wget

Up
Down

Play music from youtube without download

wget -q -O - checkip.dyndns.org|sed -e 's/.*Current IP Address: //' -e 's/<.*$//'

2009-11-06 10:18:26

User: sanjaygoel

Functions: sed wget

Tags: Network IP external

-4

Up
Down

Get your external IP address

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O - -q ip.boa.nu

2009-11-04 22:22:04

User: xeor

Functions: wget

Tags: Network IP external

-6

Up
Down

Get your external IP address

Using our beloved wget

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

clfavs(){ URL="http://www.commandlinefu.com";wget -O - --save-cookies c --post-data "username=$1&password=$2&submit=Let+me+in" $URL/users/signin;for i in `seq 0 25 $3`;do wget -O - --load-cookies c $URL/commands/favourites/plaintext/$i >>$4;done;rm -f c;}

2009-09-30 16:43:08

User: suhasgupta

Functions: c++ wget

Tags: wget commandlinefu

Up
Down

backup all your commandlinefu.com favourites to a plaintext file

Usage: clfavs username password num_favourite_commands file_in_which_to_backup

Comments (8) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget 'link of a Picasa WebAlbum' -O - |perl -e'while(<>){while(s/"media":{"content":\[{"url":"(.+?\.JPG)//){print "$1\n"}}' |wget -w1 -i -

2009-09-27 14:36:27

User: aciancone

Functions: perl wget

Tags: photos download rss picasa

Up
Down

Go get those photos from a Picasa album

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -q -O - 'http://wap.weather.gov.hk/' | sed -r 's/<[^>]+>//g;/^UV/q' | tail -n4

2009-09-25 02:36:46

User: dakunesu

Functions: sed tail wget

-1

Up
Down

get Hong Kong weather infomation from HK Observatory

"get Hong Kong weather infomation from HK Observatory

From Hong Kong Observatory wap site ;)"

other one showed alot of blank lines for me

wget -q -O - 'http://wap.weather.gov.hk/' | sed -r 's/<[^>]+>//g;/^UV/q' | grep -v '^$'

2009-09-25 02:21:05

User: twfcc

Functions: grep sed wget

-1

Up
Down

get Hong Kong weather infomation from HK Observatory

From Hong Kong Observatory wap site ;)

wget http://twitter.com/help/test.json -q -O -

2009-09-15 23:22:26

User: ninadsp

Functions: wget

Up
Down

Ping Twitter to check if you can connect

Returns a JSON object, by connecting to the 'test' endpoint of the Twitter API. Simplest way to check if you can connect to Twitter. Output also available in XML, use '/help/test.xml' for that

wget -q --spider http://server/cgi/script

2009-09-11 05:33:48

User: ashawley

Functions: wget

Tags: wget

Up
Down

Run remote web page, but don't save the results

I don't know if the --spider option works to execute a script, but it might be worth trying. Note that the Drupal project uses the following in a cron job.

wget -O - -q http://localhost/drupal/cron.php

The output is sent to standard out so it can be logged by cron.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O /dev/null http://www.google.com

2009-09-10 14:43:57

User: topher1kenobe

Functions: wget

Tags: wget

Up
Down

Run remote web page, but don't save the results

I have a remote php file that I want to run once an hour. I set up cron to run this wget. I don't really care about what's in the file though, I don't want to save the results, so I run the -O and send it to /dev/null

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -nv http://en.wikipedia.org/wiki/Linux -O- | egrep -o "http://[^[:space:]]*.jpg" | xargs -P 10 -r -n 1 wget -nv

2009-08-31 18:37:33

User: syssyphus

Functions: egrep wget xargs

Up
Down

Parallel file downloading with wget

xargs can be used in this manner to download multiple files at a time, and xargs will in this case run 10 processes at a time and initiate a new one when the number running falls below 10.

wget --reject html,htm --accept pdf,zip -rl1 url

2009-08-30 14:05:09

User: linuxswords

Functions: wget

Up
Down

get all pdf and zips from a website using wget

If the site uses https, use:

wget --reject html,htm --accept pdf,zip -rl1 --no-check-certificate https-url

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -U "QuickTime/7.6.2 (qtver=7.6.2;os=Windows NT 5.1Service Pack 3)" `echo http://movies.apple.com/movies/someHDmovie_720p.mov | sed 's/$[0-9][0-9]$0p/h\10p/'`

2009-08-29 00:29:40

User: deadrabbit

Functions: sed wget

Up
Down

Download Apple movie trailers

Copy the link to an HD movie trailer in to this command. It's more eleganant if it's put in a to a script, taking the URL as input.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

mirror=ftp://somemirror.com/with/alot/versions/but/no/latest/link; latest=$(curl -l $mirror/ 2>/dev/null | grep util | tail -1); wget $mirror/$latest

2009-08-24 15:58:31

User: peshay

Functions: grep tail wget

Up
Down

get the latest version

to download latest version of "util", maybe insert a sort if they wont be shown in right order.

curl lists all files on mirror, grep your util, tail -1 will gets the one lists on the bottom and get it with wget

for ((i=1; i<67; i++)) do wget http://www.phrack.org/archives/tgz/phrack${i}.tar.gz -q; done

2009-08-20 23:27:01

User: Abiden

Functions: wget

Up
Down

Download all Phrack .tar.gzs

This will download all the phracks! Enjoy!

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -q -O- PAGE_URL | grep -o 'WORD_OR_STRING' | wc -w

2009-08-17 13:08:46

User: evalinux

Functions: grep wc wget

Up
Down

count the appearance of a word or a string in a given webpage

Can be used to help perform some SEO optimizations.

wget -O - -q icanhazip.com

2009-08-14 10:24:30

User: andrepuel

Functions: wget

Up
Down

return external ip

I dont have curl or links installed, so I use wget with write file as standard out.

wget -qO - http://www.commandlinefu.com/feed/tenup | xmlstarlet sel -T -t -o '<x>' -n -t -m rss/channel/item -o '<y>' -n -v description -o '</y>' -n -t -o '</x>' | xmlstarlet sel -T -t -m x/y -v code -n

2009-08-14 02:44:00

User: fsilveira

Functions: wget

Tags: commandlinefu xmlstarlet rss

Up
Down

print latest (top 10, top 3 or *) commandlinefu.com commands

This lengthy cryptic line will print the latest top 10 commandlinefu.com posts without their summaries. To print also their respective summaries use the following (even bigger) command line:

wget -qO - http://www.commandlinefu.com/feed/tenup | xmlstarlet sel -T -t -o '<doc>' -n -t -m rss/channel/item -o '<item>' -n -o '<title>' -v title -o '</title>' -n -o '<description>' -v description -o '</description>' -n -o '</item>' -n -t -o '</doc>' | xmlstarlet sel -T -t -m doc/item -v description/code -n -v title -n -n

It is recommended to include this line into a shell script to be easily run, as I do myself. You could also use the following URLs to browse the top 3 commands:

wget -qO - http://www.commandlinefu.com/feed/threeup | xmlstarlet ...

.. or all others:

wget -qO - http://feeds2.feedburner.com/Command-line-fu | xmlstarlet ...

PS: You need to install "xmlstarlet" to run it. It is found in Debian APT repositories (apt-get install xmlstarlet) or under the http://xmlstar.sourceforge.net/ URL.

wget http://checkip.dyndns.org && clear && echo && echo My IP && egrep -o '([[:digit:]]{1,3}\.){3}[[:digit:]]{1,3}' index.html && echo && rm index.html

2009-08-07 21:21:59

User: onkelchentobi

Functions: clear echo egrep rm wget

-2

Up
Down

Get your external IP address

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O - http://checkip.dyndns.org|sed 's/[^0-9.]//g'

2009-08-06 12:47:32

User: thundernode

Functions: sed wget

-1

Up
Down

Get your external IP address

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

‹ First < 6 7 8 9 10 >