Commands using wget sorted by votes

Commands using wget (286)

sorted by

External IP address

Show Sample Output
This is sample output - yours may be different.
```
213.230.126.174
```
0

wget http://cmyip.com -O - -o /dev/null | grep -Po '[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+'

ruslan · 2011-02-28 16:46:14 7
Pass the proxy server address as a prefix to wget

On a machine behind a firewall, it's possible to pass the proxy server address in as a prefix to wget to avoid having to set it as an environment variable first.
This is sample output - yours may be different.
0

http_proxy=<proxy.server:port> wget <url>

rdc · 2011-03-30 13:06:19 3
check broken links using wget as a spider

This will visit recursively all linked urls starting from the specified URL. It won't save anything locally and it will produce a detailed log. Useful to find broken links in your site. It ignores robots.txt, so just use it on a site you own!
This is sample output - yours may be different.
0

wget --spider -o wget.log -e robots=off --wait 1 -r -p http://www.example.com

lele · 2011-04-05 13:42:14 4
Write a bootable Linux .iso file directly to a USB-stick

This wgets the iso directly to the USB device, replace /dev/sdb with the device name of the USB stick. After wget finishes you will be able to boot the .iso file from the USB stick.
This is sample output - yours may be different.
0

wget -O/dev/sdb ftp://ftp.debian.org/debian/dists/stable/main/installer-amd64/current/images/netboot/mini.iso

unixmonkey22563 · 2011-06-12 21:58:13 36
Download a set of files that are numbered
This is sample output - yours may be different.
0

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

totti · 2011-08-19 20:06:16 5
Gets the english pronunciation of a phrase

No need to install additional packages eg: say hello For multiword say how+are+you
This is sample output - yours may be different.
0

say() { wget -q -U Mozilla -O output.mp3 "http://translate.google.com/translate_tts?tl=en&q=$1"; gnome-terminal -x bash -c "totem output.mp3"; sleep 4; totem --quit;}

totti · 2011-09-07 19:48:53 3
download all jpg in webpage
This is sample output - yours may be different.
0

curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-

kev · 2011-09-10 19:21:13 4
Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates. Usage: wgetall mp3 http://example.com/download/
This is sample output - yours may be different.
0

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

peterRepeater · 2011-09-28 09:43:25 3
AmazonMP3 Daily Deals

grabs and prints the AmazonMP3 daily album deal
This is sample output - yours may be different.
0

wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'

winsbe01 · 2011-10-06 20:27:02 3
Encrypt text to md5

Encrypt any text to MD5 , replace text with the string you want to convert to MD5 Show Sample Output
This is sample output - yours may be different.
```
1cb251ec0d568de6a929b520c4aed8d1
```
0

wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

samhagin · 2011-10-13 03:44:48 3
Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from: expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
Location: http://is.gd/jAdSZ3 [following]
Location: https://wiki.ubuntu.com/UbuntuOpenWeek [following]
```
0

expandurl() { wget -S $1 2>&1 | grep ^Location; }

atoponce · 2011-10-18 18:50:54 11
What is my public IP address

Uses wget standard GNU utility. Prints only your ip.
This is sample output - yours may be different.
0

wget -qO - http://whatismyip.org | tail

Flolagale · 2012-03-17 10:13:05 3
set desktop background to highest-rated image from Reddit /r/wallpapers

Doesn't depend on curl and doesn't use thumbnails as wallpaper (which has the unfortunate effect of only allowing imgur links)
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpapers.rss | grep -Eo 'http://i.imgur.com[^&]+jpg' | head -1 | xargs wget -O background.jpg

untitaker · 2012-04-25 11:15:26 4
Random (sfw, 1920x1080) wallpaper from wallbase.cc
This is sample output - yours may be different.
0

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

yosh · 2012-08-14 22:06:27 3
Mirror site with rel-links, 20s delay via Wget
This is sample output - yours may be different.
0

wget -mk -w 20 http://www.example.com/

evandrix · 2012-08-27 14:33:48 4

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Download an entire static website to your local machine
This is sample output - yours may be different.
0

wget --recursive --page-requisites --convert-links www.moyagraphix.co.za

bayu_aritedjo · 2012-12-21 08:23:54 4
Download and extract a tarball on a fly, saving it

Very similar as doing "wget http://example.com/mytarball|tar xzv", this one involves the "tee" command between both, which will simultaneously write the tarball and copy it to stdout. So this command will locally save the tarball and extract it - both at the same time while it downloads.
This is sample output - yours may be different.
0

wget -O- http://example.com/mytarball.tgz | tee mytarball.tgz | tar xzv

unixmonkey48888 · 2013-03-06 11:11:28 4
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 4
Twitter Account Validator

Reason can be: taken, available, contains_banned_word
This is sample output - yours may be different.
0

if wget https://twitter.com/users/username_available?username=xmuda -q -O - | grep -q "\"reason\":\"taken\""; then echo "Username taken"; else echo "Free / Banned Name"; fi

Joschasa · 2013-03-23 17:39:15 4
remove old index.html if you download it again and organiaz the java script tag on the file index.html

remove old index.html if you download it again and organiaz the java script tag on the file index.html
This is sample output - yours may be different.
0

rm index.html | wget www.google.com;cat index.html | sed 's/<script>/\n\n\<script>\n\n/g' | sed 's/<\/script>/>\n\n/g'

lbhack · 2013-04-10 04:05:30 5
Geo Location of an IP-address

This command will help you to get Ip address origin of city and country. I will be happy if someone can shrink the sed command fb.me/josenirmal Show Sample Output
This is sample output - yours may be different.
```
Country:<name of the country>
City:<name of the city>
```
0

wget -qO - whatismyipaddress.com/ip/<type ip address> | grep -E "City:|Country:" | sed 's:<tr><th>::'| sed 's</th>::' | sed 's:</td>::' | sed 's:</tr>::' | sed 's:<img*::'

pentester · 2013-06-21 03:27:09 8
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

site=https://www.duden.de; wort="Apfel"; wget -O $wort.mp3 $(wget -O - "$site/rechtschreibung/$wort" | grep -o "$site/_media_/audio/[^\.]*\.mp3")

oldo · 2013-07-31 19:38:59 7

Download files linked in a RSS feed

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 22

Download current stable kernel version from kernel.org

Access www.kernel.org and download the last stable linux kernel release. Show Sample Output

wget --no-check-certificate https://www.kernel.org/$(wget -qO- --no-check-certificate https://www.kernel.org | grep tar | head -n1 | cut -d\" -f2)

glaudiston · 2013-11-07 18:46:14 8

‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Start dd and show progress every X seconds

Adjust "sleep X" to your needs. *NOTE: First sleep is required because bash doesn't have a "post-test" syntax (do XXX while).

set history file length

set how many commands to keep in history Default is 500 Saved in /home/$USER/.bash_history Add this to /home/$USER/.bashrc HISTFILESIZE=1000000000 HISTSIZE=1000000

Get the canonical, absolute path given a relative and/or noncanonical path

readlink -f accepts a relative, noncanonical path and emits the corresponding canonical, absolute path.

check for write/read permissions

su www-apache/ftp user and then check readable: find ~/ -type d $ -wholename '/dev/*' -o -wholename '/sys/*' -o -wholename '/proc/*' $ -prune -o -exec test -r {} \; -exec echo {} readable \; 2>/dev/null check writable: find ~/ -type d $ -wholename '/dev/*' -o -wholename '/sys/*' -o -wholename '/proc/*' $ -prune -o -exec test -w {} \; -exec echo {} writable \; 2>/dev/null

Copy a directory recursively without data/files

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

keep a log of the active windows

This logs the titles of the active windows, thus you can monitor what you have done during which times. (it is not hard to also log the executable name, but then it is gets too long)

left-right mouse buttons (left-handed)

Generic shell function for modifying files in-place

Some commands (such as sed and perl) have options to support in-place editing of files, but many commands do not. This shell function enables any command to change files in place. See the sample output for many examples. The function uses plain sh syntax and works with any POSIX shell or derivative, including zsh and bash.

Produce a pseudo random password with given length in base 64

Don't copy trailing '=' or use head -c to limit to desired length.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by