Commands using wget sorted by votes

Commands using wget (286)

sorted by

External IP address

Show Sample Output
This is sample output - yours may be different.
```
213.230.126.174
```
0

wget http://cmyip.com -O - -o /dev/null | grep -Po '[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+'

ruslan · 2011-02-28 16:46:14 7
Pass the proxy server address as a prefix to wget

On a machine behind a firewall, it's possible to pass the proxy server address in as a prefix to wget to avoid having to set it as an environment variable first.
This is sample output - yours may be different.
0

http_proxy=<proxy.server:port> wget <url>

rdc · 2011-03-30 13:06:19 3
check broken links using wget as a spider

This will visit recursively all linked urls starting from the specified URL. It won't save anything locally and it will produce a detailed log. Useful to find broken links in your site. It ignores robots.txt, so just use it on a site you own!
This is sample output - yours may be different.
0

wget --spider -o wget.log -e robots=off --wait 1 -r -p http://www.example.com

lele · 2011-04-05 13:42:14 4
Write a bootable Linux .iso file directly to a USB-stick

This wgets the iso directly to the USB device, replace /dev/sdb with the device name of the USB stick. After wget finishes you will be able to boot the .iso file from the USB stick.
This is sample output - yours may be different.
0

wget -O/dev/sdb ftp://ftp.debian.org/debian/dists/stable/main/installer-amd64/current/images/netboot/mini.iso

unixmonkey22563 · 2011-06-12 21:58:13 36
Download a set of files that are numbered
This is sample output - yours may be different.
0

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

totti · 2011-08-19 20:06:16 5
Gets the english pronunciation of a phrase

No need to install additional packages eg: say hello For multiword say how+are+you
This is sample output - yours may be different.
0

say() { wget -q -U Mozilla -O output.mp3 "http://translate.google.com/translate_tts?tl=en&q=$1"; gnome-terminal -x bash -c "totem output.mp3"; sleep 4; totem --quit;}

totti · 2011-09-07 19:48:53 3
download all jpg in webpage
This is sample output - yours may be different.
0

curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-

kev · 2011-09-10 19:21:13 4
Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates. Usage: wgetall mp3 http://example.com/download/
This is sample output - yours may be different.
0

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

peterRepeater · 2011-09-28 09:43:25 3
AmazonMP3 Daily Deals

grabs and prints the AmazonMP3 daily album deal
This is sample output - yours may be different.
0

wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'

winsbe01 · 2011-10-06 20:27:02 3
Encrypt text to md5

Encrypt any text to MD5 , replace text with the string you want to convert to MD5 Show Sample Output
This is sample output - yours may be different.
```
1cb251ec0d568de6a929b520c4aed8d1
```
0

wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

samhagin · 2011-10-13 03:44:48 3
Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from: expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
Location: http://is.gd/jAdSZ3 [following]
Location: https://wiki.ubuntu.com/UbuntuOpenWeek [following]
```
0

expandurl() { wget -S $1 2>&1 | grep ^Location; }

atoponce · 2011-10-18 18:50:54 11
What is my public IP address

Uses wget standard GNU utility. Prints only your ip.
This is sample output - yours may be different.
0

wget -qO - http://whatismyip.org | tail

Flolagale · 2012-03-17 10:13:05 3
set desktop background to highest-rated image from Reddit /r/wallpapers

Doesn't depend on curl and doesn't use thumbnails as wallpaper (which has the unfortunate effect of only allowing imgur links)
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpapers.rss | grep -Eo 'http://i.imgur.com[^&]+jpg' | head -1 | xargs wget -O background.jpg

untitaker · 2012-04-25 11:15:26 4
Random (sfw, 1920x1080) wallpaper from wallbase.cc
This is sample output - yours may be different.
0

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

yosh · 2012-08-14 22:06:27 3
Mirror site with rel-links, 20s delay via Wget
This is sample output - yours may be different.
0

wget -mk -w 20 http://www.example.com/

evandrix · 2012-08-27 14:33:48 4

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Download an entire static website to your local machine
This is sample output - yours may be different.
0

wget --recursive --page-requisites --convert-links www.moyagraphix.co.za

bayu_aritedjo · 2012-12-21 08:23:54 4
Download and extract a tarball on a fly, saving it

Very similar as doing "wget http://example.com/mytarball|tar xzv", this one involves the "tee" command between both, which will simultaneously write the tarball and copy it to stdout. So this command will locally save the tarball and extract it - both at the same time while it downloads.
This is sample output - yours may be different.
0

wget -O- http://example.com/mytarball.tgz | tee mytarball.tgz | tar xzv

unixmonkey48888 · 2013-03-06 11:11:28 4
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 4
Twitter Account Validator

Reason can be: taken, available, contains_banned_word
This is sample output - yours may be different.
0

if wget https://twitter.com/users/username_available?username=xmuda -q -O - | grep -q "\"reason\":\"taken\""; then echo "Username taken"; else echo "Free / Banned Name"; fi

Joschasa · 2013-03-23 17:39:15 4
remove old index.html if you download it again and organiaz the java script tag on the file index.html

remove old index.html if you download it again and organiaz the java script tag on the file index.html
This is sample output - yours may be different.
0

rm index.html | wget www.google.com;cat index.html | sed 's/<script>/\n\n\<script>\n\n/g' | sed 's/<\/script>/>\n\n/g'

lbhack · 2013-04-10 04:05:30 5
Geo Location of an IP-address

This command will help you to get Ip address origin of city and country. I will be happy if someone can shrink the sed command fb.me/josenirmal Show Sample Output
This is sample output - yours may be different.
```
Country:<name of the country>
City:<name of the city>
```
0

wget -qO - whatismyipaddress.com/ip/<type ip address> | grep -E "City:|Country:" | sed 's:<tr><th>::'| sed 's</th>::' | sed 's:</td>::' | sed 's:</tr>::' | sed 's:<img*::'

pentester · 2013-06-21 03:27:09 8
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

site=https://www.duden.de; wort="Apfel"; wget -O $wort.mp3 $(wget -O - "$site/rechtschreibung/$wort" | grep -o "$site/_media_/audio/[^\.]*\.mp3")

oldo · 2013-07-31 19:38:59 7

Download files linked in a RSS feed

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 22

Download current stable kernel version from kernel.org

Access www.kernel.org and download the last stable linux kernel release. Show Sample Output

wget --no-check-certificate https://www.kernel.org/$(wget -qO- --no-check-certificate https://www.kernel.org | grep tar | head -n1 | cut -d\" -f2)

glaudiston · 2013-11-07 18:46:14 8

‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Find top 10 largest files

Check all bash scripts in current dir for syntax errors

Check all bash scripts in current dir for syntax errors WITHOUT running them.

Compare two CSV files, discarding any repeated lines

The value for the sort command's -k argument is the column in the CSV file to sort on. In this example, it sorts on the second column. You must use some form of the sort command in order for uniq to work properly.

An alarm clock using xmms2 and at

Nice little alarm clock to wake you up on time (hopefully). You can also do 'echo "vlc path/to/song" | at 6:00

Extract track 9 from a CD

Using mplayer to extract audio file from a CD

Pretty print SQL query with python in one line

You need to apt-get install python-sqlparse. This command simply formats a sql query and prints it out. It is very useful when you want to move a sql query from commandline to a shell script. Everything is done locally, so you don't need to worry about copying sql query to external websites.

list files recursively by size

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Partition a sequence of disk drives for LVM with fdisk

So, I'm using a CentOS VM in VirtualBox, and created four new disks in the SCSI controller. The VM created the folders: /dev/sda /dev/sdb /dev/sdc /dev/sdd Using a 'for loop' all disks are partitioned for LVM.

Recursive Ownership Change

Changing files ownership in a directory recursivley from a user to another

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by