Commands using wget sorted by votes

Commands using wget (286)

sorted by

External IP address

Show Sample Output
This is sample output - yours may be different.
```
213.230.126.174
```
0

wget http://cmyip.com -O - -o /dev/null | grep -Po '[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+'

ruslan · 2011-02-28 16:46:14 57
Pass the proxy server address as a prefix to wget

On a machine behind a firewall, it's possible to pass the proxy server address in as a prefix to wget to avoid having to set it as an environment variable first.
This is sample output - yours may be different.
0

http_proxy=<proxy.server:port> wget <url>

rdc · 2011-03-30 13:06:19 4
check broken links using wget as a spider

This will visit recursively all linked urls starting from the specified URL. It won't save anything locally and it will produce a detailed log. Useful to find broken links in your site. It ignores robots.txt, so just use it on a site you own!
This is sample output - yours may be different.
0

wget --spider -o wget.log -e robots=off --wait 1 -r -p http://www.example.com

lele · 2011-04-05 13:42:14 5
Write a bootable Linux .iso file directly to a USB-stick

This wgets the iso directly to the USB device, replace /dev/sdb with the device name of the USB stick. After wget finishes you will be able to boot the .iso file from the USB stick.
This is sample output - yours may be different.
0

wget -O/dev/sdb ftp://ftp.debian.org/debian/dists/stable/main/installer-amd64/current/images/netboot/mini.iso

unixmonkey22563 · 2011-06-12 21:58:13 37
Download a set of files that are numbered
This is sample output - yours may be different.
0

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

totti · 2011-08-19 20:06:16 6
Gets the english pronunciation of a phrase

No need to install additional packages eg: say hello For multiword say how+are+you
This is sample output - yours may be different.
0

say() { wget -q -U Mozilla -O output.mp3 "http://translate.google.com/translate_tts?tl=en&q=$1"; gnome-terminal -x bash -c "totem output.mp3"; sleep 4; totem --quit;}

totti · 2011-09-07 19:48:53 4
download all jpg in webpage
This is sample output - yours may be different.
0

curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-

kev · 2011-09-10 19:21:13 5
Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates. Usage: wgetall mp3 http://example.com/download/
This is sample output - yours may be different.
0

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

peterRepeater · 2011-09-28 09:43:25 4
AmazonMP3 Daily Deals

grabs and prints the AmazonMP3 daily album deal
This is sample output - yours may be different.
0

wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'

winsbe01 · 2011-10-06 20:27:02 4
Encrypt text to md5

Encrypt any text to MD5 , replace text with the string you want to convert to MD5 Show Sample Output
This is sample output - yours may be different.
```
1cb251ec0d568de6a929b520c4aed8d1
```
0

wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

samhagin · 2011-10-13 03:44:48 4
Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from: expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
Location: http://is.gd/jAdSZ3 [following]
Location: https://wiki.ubuntu.com/UbuntuOpenWeek [following]
```
0

expandurl() { wget -S $1 2>&1 | grep ^Location; }

atoponce · 2011-10-18 18:50:54 12
What is my public IP address

Uses wget standard GNU utility. Prints only your ip.
This is sample output - yours may be different.
0

wget -qO - http://whatismyip.org | tail

Flolagale · 2012-03-17 10:13:05 4
set desktop background to highest-rated image from Reddit /r/wallpapers

Doesn't depend on curl and doesn't use thumbnails as wallpaper (which has the unfortunate effect of only allowing imgur links)
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpapers.rss | grep -Eo 'http://i.imgur.com[^&]+jpg' | head -1 | xargs wget -O background.jpg

untitaker · 2012-04-25 11:15:26 5
Random (sfw, 1920x1080) wallpaper from wallbase.cc
This is sample output - yours may be different.
0

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

yosh · 2012-08-14 22:06:27 4
Mirror site with rel-links, 20s delay via Wget
This is sample output - yours may be different.
0

wget -mk -w 20 http://www.example.com/

evandrix · 2012-08-27 14:33:48 5

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 6

Download an entire static website to your local machine
This is sample output - yours may be different.
0

wget --recursive --page-requisites --convert-links www.moyagraphix.co.za

bayu_aritedjo · 2012-12-21 08:23:54 5
Download and extract a tarball on a fly, saving it

Very similar as doing "wget http://example.com/mytarball|tar xzv", this one involves the "tee" command between both, which will simultaneously write the tarball and copy it to stdout. So this command will locally save the tarball and extract it - both at the same time while it downloads.
This is sample output - yours may be different.
0

wget -O- http://example.com/mytarball.tgz | tee mytarball.tgz | tar xzv

unixmonkey48888 · 2013-03-06 11:11:28 5
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 5
Twitter Account Validator

Reason can be: taken, available, contains_banned_word
This is sample output - yours may be different.
0

if wget https://twitter.com/users/username_available?username=xmuda -q -O - | grep -q "\"reason\":\"taken\""; then echo "Username taken"; else echo "Free / Banned Name"; fi

Joschasa · 2013-03-23 17:39:15 5
remove old index.html if you download it again and organiaz the java script tag on the file index.html

remove old index.html if you download it again and organiaz the java script tag on the file index.html
This is sample output - yours may be different.
0

rm index.html | wget www.google.com;cat index.html | sed 's/<script>/\n\n\<script>\n\n/g' | sed 's/<\/script>/>\n\n/g'

lbhack · 2013-04-10 04:05:30 6
Geo Location of an IP-address

This command will help you to get Ip address origin of city and country. I will be happy if someone can shrink the sed command fb.me/josenirmal Show Sample Output
This is sample output - yours may be different.
```
Country:<name of the country>
City:<name of the city>
```
0

wget -qO - whatismyipaddress.com/ip/<type ip address> | grep -E "City:|Country:" | sed 's:<tr><th>::'| sed 's</th>::' | sed 's:</td>::' | sed 's:</tr>::' | sed 's:<img*::'

pentester · 2013-06-21 03:27:09 9
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

site=https://www.duden.de; wort="Apfel"; wget -O $wort.mp3 $(wget -O - "$site/rechtschreibung/$wort" | grep -o "$site/_media_/audio/[^\.]*\.mp3")

oldo · 2013-07-31 19:38:59 8

Download files linked in a RSS feed

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 23

Download current stable kernel version from kernel.org

Access www.kernel.org and download the last stable linux kernel release. Show Sample Output

wget --no-check-certificate https://www.kernel.org/$(wget -qO- --no-check-certificate https://www.kernel.org | grep tar | head -n1 | cut -d\" -f2)

glaudiston · 2013-11-07 18:46:14 9

‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

floating point operations in shell scripts

using bc is for sissies. dc is much better :-D Polish notation will rule the world...

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Advanced python tracing

Trace python statement execution and syscalls invoked during that simultaneously

analyze traffic remotely over ssh w/ wireshark

This captures traffic on a remote machine with tshark, sends the raw pcap data over the ssh link, and displays it in wireshark. Hitting ctrl+C will stop the capture and unfortunately close your wireshark window. This can be worked-around by passing -c # to tshark to only capture a certain # of packets, or redirecting the data through a named pipe rather than piping directly from ssh to wireshark. I recommend filtering as much as you can in the tshark command to conserve bandwidth. tshark can be replaced with tcpdump thusly: $ ssh root@example.com tcpdump -w - 'port !22' | wireshark -k -i -

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

SSH Auto-login with password

You need to install "sshpass" for this to work. apt-get install sshpass

Prints line numbers

If you don't have nl on your system, this achieves a similar effect, the default behavior in nl is to not number blank lines, but this does.

rename anime fansubs

renames Anime Episodes to files, that can be parsed by sonarr & co

Get the total length of time in hours:minutes:seconds (HH:MM:SS) of all video (or audio) in the current dir (and below)

change the *.avi to whatever you want to match, you can remove it altogether if you want to check all files.

List Network Tools in Linux

Get all the networking related commands for your distro

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by