Commands using wget sorted by votes

Commands using wget (286)

sorted by

External IP address

Show Sample Output
This is sample output - yours may be different.
```
213.230.126.174
```
0

wget http://cmyip.com -O - -o /dev/null | grep -Po '[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+'

ruslan · 2011-02-28 16:46:14 7
Pass the proxy server address as a prefix to wget

On a machine behind a firewall, it's possible to pass the proxy server address in as a prefix to wget to avoid having to set it as an environment variable first.
This is sample output - yours may be different.
0

http_proxy=<proxy.server:port> wget <url>

rdc · 2011-03-30 13:06:19 3
check broken links using wget as a spider

This will visit recursively all linked urls starting from the specified URL. It won't save anything locally and it will produce a detailed log. Useful to find broken links in your site. It ignores robots.txt, so just use it on a site you own!
This is sample output - yours may be different.
0

wget --spider -o wget.log -e robots=off --wait 1 -r -p http://www.example.com

lele · 2011-04-05 13:42:14 4
Write a bootable Linux .iso file directly to a USB-stick

This wgets the iso directly to the USB device, replace /dev/sdb with the device name of the USB stick. After wget finishes you will be able to boot the .iso file from the USB stick.
This is sample output - yours may be different.
0

wget -O/dev/sdb ftp://ftp.debian.org/debian/dists/stable/main/installer-amd64/current/images/netboot/mini.iso

unixmonkey22563 · 2011-06-12 21:58:13 36
Download a set of files that are numbered
This is sample output - yours may be different.
0

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

totti · 2011-08-19 20:06:16 5
Gets the english pronunciation of a phrase

No need to install additional packages eg: say hello For multiword say how+are+you
This is sample output - yours may be different.
0

say() { wget -q -U Mozilla -O output.mp3 "http://translate.google.com/translate_tts?tl=en&q=$1"; gnome-terminal -x bash -c "totem output.mp3"; sleep 4; totem --quit;}

totti · 2011-09-07 19:48:53 3
download all jpg in webpage
This is sample output - yours may be different.
0

curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-

kev · 2011-09-10 19:21:13 4
Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates. Usage: wgetall mp3 http://example.com/download/
This is sample output - yours may be different.
0

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

peterRepeater · 2011-09-28 09:43:25 3
AmazonMP3 Daily Deals

grabs and prints the AmazonMP3 daily album deal
This is sample output - yours may be different.
0

wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'

winsbe01 · 2011-10-06 20:27:02 3
Encrypt text to md5

Encrypt any text to MD5 , replace text with the string you want to convert to MD5 Show Sample Output
This is sample output - yours may be different.
```
1cb251ec0d568de6a929b520c4aed8d1
```
0

wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

samhagin · 2011-10-13 03:44:48 3
Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from: expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
Location: http://is.gd/jAdSZ3 [following]
Location: https://wiki.ubuntu.com/UbuntuOpenWeek [following]
```
0

expandurl() { wget -S $1 2>&1 | grep ^Location; }

atoponce · 2011-10-18 18:50:54 11
What is my public IP address

Uses wget standard GNU utility. Prints only your ip.
This is sample output - yours may be different.
0

wget -qO - http://whatismyip.org | tail

Flolagale · 2012-03-17 10:13:05 3
set desktop background to highest-rated image from Reddit /r/wallpapers

Doesn't depend on curl and doesn't use thumbnails as wallpaper (which has the unfortunate effect of only allowing imgur links)
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpapers.rss | grep -Eo 'http://i.imgur.com[^&]+jpg' | head -1 | xargs wget -O background.jpg

untitaker · 2012-04-25 11:15:26 4
Random (sfw, 1920x1080) wallpaper from wallbase.cc
This is sample output - yours may be different.
0

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

yosh · 2012-08-14 22:06:27 3
Mirror site with rel-links, 20s delay via Wget
This is sample output - yours may be different.
0

wget -mk -w 20 http://www.example.com/

evandrix · 2012-08-27 14:33:48 4

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Download an entire static website to your local machine
This is sample output - yours may be different.
0

wget --recursive --page-requisites --convert-links www.moyagraphix.co.za

bayu_aritedjo · 2012-12-21 08:23:54 4
Download and extract a tarball on a fly, saving it

Very similar as doing "wget http://example.com/mytarball|tar xzv", this one involves the "tee" command between both, which will simultaneously write the tarball and copy it to stdout. So this command will locally save the tarball and extract it - both at the same time while it downloads.
This is sample output - yours may be different.
0

wget -O- http://example.com/mytarball.tgz | tee mytarball.tgz | tar xzv

unixmonkey48888 · 2013-03-06 11:11:28 4
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 4
Twitter Account Validator

Reason can be: taken, available, contains_banned_word
This is sample output - yours may be different.
0

if wget https://twitter.com/users/username_available?username=xmuda -q -O - | grep -q "\"reason\":\"taken\""; then echo "Username taken"; else echo "Free / Banned Name"; fi

Joschasa · 2013-03-23 17:39:15 4
remove old index.html if you download it again and organiaz the java script tag on the file index.html

remove old index.html if you download it again and organiaz the java script tag on the file index.html
This is sample output - yours may be different.
0

rm index.html | wget www.google.com;cat index.html | sed 's/<script>/\n\n\<script>\n\n/g' | sed 's/<\/script>/>\n\n/g'

lbhack · 2013-04-10 04:05:30 5
Geo Location of an IP-address

This command will help you to get Ip address origin of city and country. I will be happy if someone can shrink the sed command fb.me/josenirmal Show Sample Output
This is sample output - yours may be different.
```
Country:<name of the country>
City:<name of the city>
```
0

wget -qO - whatismyipaddress.com/ip/<type ip address> | grep -E "City:|Country:" | sed 's:<tr><th>::'| sed 's</th>::' | sed 's:</td>::' | sed 's:</tr>::' | sed 's:<img*::'

pentester · 2013-06-21 03:27:09 8
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

site=https://www.duden.de; wort="Apfel"; wget -O $wort.mp3 $(wget -O - "$site/rechtschreibung/$wort" | grep -o "$site/_media_/audio/[^\.]*\.mp3")

oldo · 2013-07-31 19:38:59 7

Download files linked in a RSS feed

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 22

Download current stable kernel version from kernel.org

Access www.kernel.org and download the last stable linux kernel release. Show Sample Output

wget --no-check-certificate https://www.kernel.org/$(wget -qO- --no-check-certificate https://www.kernel.org | grep tar | head -n1 | cut -d\" -f2)

glaudiston · 2013-11-07 18:46:14 8

‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

grep certain file types recursively

-exec works better and faster then using a pipe

Monitor a file with tail with timestamps added

Toggle between directories

switch to previous directory or toggle

Decrypt exported android wallet keys for import into desktop client (LTC,FTC,BTC)

Random IPv4 address

Follow the most recently updated log files

This command finds the 5 (-n5) most frequently updated logs in /var/log, and then does a multifile tail follow of those log files. Alternately, you can do this to follow a specific list of log files: sudo tail -n0 -f /var/log/{messages,secure,cron,cups/error_log}

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

ps with parent/child process tree

Shows a tree view of parent to child processes in the output of ps (linux). Similar output can be achieved with pstree (also linux) or ptree (Solaris).

Write a listing of all directories and files on the computer to a compressed file.

This command is meant to be used to make a lightweight backup, for when you want to know which files might be missing or changed, but you don't care about their contents (because you have some way to recover them). Explanation of parts: "ls -RFal /" lists all files in and below the root directory, along with their permissions and some other metadata. I think sudo is necessary to allow ls to read the metadata of certain files. "| gzip" compresses the result, from 177 MB to 16 MB in my case. "> all_files_list.txt.gz" saves the result to a file in the current directory called all_files_list.txt.gz. This name can be changed, of course.

Convert records in columns to csv

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by