Commands using wget sorted by votes

Commands using wget (286)

sorted by

External IP address

Show Sample Output
This is sample output - yours may be different.
```
213.230.126.174
```
0

wget http://cmyip.com -O - -o /dev/null | grep -Po '[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+'

ruslan · 2011-02-28 16:46:14 7
Pass the proxy server address as a prefix to wget

On a machine behind a firewall, it's possible to pass the proxy server address in as a prefix to wget to avoid having to set it as an environment variable first.
This is sample output - yours may be different.
0

http_proxy=<proxy.server:port> wget <url>

rdc · 2011-03-30 13:06:19 3
check broken links using wget as a spider

This will visit recursively all linked urls starting from the specified URL. It won't save anything locally and it will produce a detailed log. Useful to find broken links in your site. It ignores robots.txt, so just use it on a site you own!
This is sample output - yours may be different.
0

wget --spider -o wget.log -e robots=off --wait 1 -r -p http://www.example.com

lele · 2011-04-05 13:42:14 4
Write a bootable Linux .iso file directly to a USB-stick

This wgets the iso directly to the USB device, replace /dev/sdb with the device name of the USB stick. After wget finishes you will be able to boot the .iso file from the USB stick.
This is sample output - yours may be different.
0

wget -O/dev/sdb ftp://ftp.debian.org/debian/dists/stable/main/installer-amd64/current/images/netboot/mini.iso

unixmonkey22563 · 2011-06-12 21:58:13 36
Download a set of files that are numbered
This is sample output - yours may be different.
0

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

totti · 2011-08-19 20:06:16 5
Gets the english pronunciation of a phrase

No need to install additional packages eg: say hello For multiword say how+are+you
This is sample output - yours may be different.
0

say() { wget -q -U Mozilla -O output.mp3 "http://translate.google.com/translate_tts?tl=en&q=$1"; gnome-terminal -x bash -c "totem output.mp3"; sleep 4; totem --quit;}

totti · 2011-09-07 19:48:53 3
download all jpg in webpage
This is sample output - yours may be different.
0

curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-

kev · 2011-09-10 19:21:13 4
Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates. Usage: wgetall mp3 http://example.com/download/
This is sample output - yours may be different.
0

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

peterRepeater · 2011-09-28 09:43:25 3
AmazonMP3 Daily Deals

grabs and prints the AmazonMP3 daily album deal
This is sample output - yours may be different.
0

wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'

winsbe01 · 2011-10-06 20:27:02 3
Encrypt text to md5

Encrypt any text to MD5 , replace text with the string you want to convert to MD5 Show Sample Output
This is sample output - yours may be different.
```
1cb251ec0d568de6a929b520c4aed8d1
```
0

wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

samhagin · 2011-10-13 03:44:48 3
Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from: expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
Location: http://is.gd/jAdSZ3 [following]
Location: https://wiki.ubuntu.com/UbuntuOpenWeek [following]
```
0

expandurl() { wget -S $1 2>&1 | grep ^Location; }

atoponce · 2011-10-18 18:50:54 11
What is my public IP address

Uses wget standard GNU utility. Prints only your ip.
This is sample output - yours may be different.
0

wget -qO - http://whatismyip.org | tail

Flolagale · 2012-03-17 10:13:05 3
set desktop background to highest-rated image from Reddit /r/wallpapers

Doesn't depend on curl and doesn't use thumbnails as wallpaper (which has the unfortunate effect of only allowing imgur links)
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpapers.rss | grep -Eo 'http://i.imgur.com[^&]+jpg' | head -1 | xargs wget -O background.jpg

untitaker · 2012-04-25 11:15:26 4
Random (sfw, 1920x1080) wallpaper from wallbase.cc
This is sample output - yours may be different.
0

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

yosh · 2012-08-14 22:06:27 3
Mirror site with rel-links, 20s delay via Wget
This is sample output - yours may be different.
0

wget -mk -w 20 http://www.example.com/

evandrix · 2012-08-27 14:33:48 4

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Download an entire static website to your local machine
This is sample output - yours may be different.
0

wget --recursive --page-requisites --convert-links www.moyagraphix.co.za

bayu_aritedjo · 2012-12-21 08:23:54 4
Download and extract a tarball on a fly, saving it

Very similar as doing "wget http://example.com/mytarball|tar xzv", this one involves the "tee" command between both, which will simultaneously write the tarball and copy it to stdout. So this command will locally save the tarball and extract it - both at the same time while it downloads.
This is sample output - yours may be different.
0

wget -O- http://example.com/mytarball.tgz | tee mytarball.tgz | tar xzv

unixmonkey48888 · 2013-03-06 11:11:28 4
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 4
Twitter Account Validator

Reason can be: taken, available, contains_banned_word
This is sample output - yours may be different.
0

if wget https://twitter.com/users/username_available?username=xmuda -q -O - | grep -q "\"reason\":\"taken\""; then echo "Username taken"; else echo "Free / Banned Name"; fi

Joschasa · 2013-03-23 17:39:15 4
remove old index.html if you download it again and organiaz the java script tag on the file index.html

remove old index.html if you download it again and organiaz the java script tag on the file index.html
This is sample output - yours may be different.
0

rm index.html | wget www.google.com;cat index.html | sed 's/<script>/\n\n\<script>\n\n/g' | sed 's/<\/script>/>\n\n/g'

lbhack · 2013-04-10 04:05:30 5
Geo Location of an IP-address

This command will help you to get Ip address origin of city and country. I will be happy if someone can shrink the sed command fb.me/josenirmal Show Sample Output
This is sample output - yours may be different.
```
Country:<name of the country>
City:<name of the city>
```
0

wget -qO - whatismyipaddress.com/ip/<type ip address> | grep -E "City:|Country:" | sed 's:<tr><th>::'| sed 's</th>::' | sed 's:</td>::' | sed 's:</tr>::' | sed 's:<img*::'

pentester · 2013-06-21 03:27:09 8
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

site=https://www.duden.de; wort="Apfel"; wget -O $wort.mp3 $(wget -O - "$site/rechtschreibung/$wort" | grep -o "$site/_media_/audio/[^\.]*\.mp3")

oldo · 2013-07-31 19:38:59 7

Download files linked in a RSS feed

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 22

Download current stable kernel version from kernel.org

Access www.kernel.org and download the last stable linux kernel release. Show Sample Output

wget --no-check-certificate https://www.kernel.org/$(wget -qO- --no-check-certificate https://www.kernel.org | grep tar | head -n1 | cut -d\" -f2)

glaudiston · 2013-11-07 18:46:14 8

‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Find Duplicate Files (based on size first, then MD5 hash)

for OS X

download file1 file2 file3 file4 .... file 100

Detect illegal access to kernel space, potentially useful for Meltdown detection

Based on capsule8 agent examples, not rigorously tested

awk using multiple field separators

You can use multiple field separators by separating them with | (=or). This may be helpful when you want to split a string by two separators for example. #echo "one=two three" | awk -F "=| " {'print $1, $3'} one three

delay execution of a command that needs lots of memory and CPU time until the resources are available

[ 2000 -ge "$(free -m | awk '/buffers.cache:/ {print $4}')" ] returns true if less than 2000 MB of RAM are available, so adjust this number to your needs. [ $(echo "$(uptime | awk '{print $10}' | sed -e 's/,$//' -e 's/,/./') >= $(grep -c ^processor /proc/cpuinfo)" | bc) -eq 1 ] returns true if the current machine load is at least equal to the number of CPUs. If either of the tests returns true we wait 10 seconds and check again. If both tests return false, i.e. 2GB are available and machine load falls below number of CPUs, we start our command and save it's output in a text file. The ( ( ... ) & ) construct lets the command run in background even if we log out. See http://www.commandlinefu.com/commands/view/3115/ .

Delete all empty lines from a file with vim

If you need to delete lines that may contain space characters (such as tabs or spaces) as well as empty ones, try: $:v/\S/d Just an alternative.

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

a function to find the fastest DNS server

http://public-dns.info gives a list of online dns servers. you need to change the country in url (br in this url) with your country code. this command need some time to ping all IP in list.

a find and replace within text-based files

using find's exec option instead of a for loop and using sed's -i option for inplace replacement. no need to do the file swap.

Search for a string inside all files in the current directory

This is how I typically grep. -R recurse into subdirectories, -n show line numbers of matches, -i ignore case, -s suppress "doesn't exist" and "can't read" messages, -I ignore binary files (technically, process them as having no matches, important for showing inverted results with -v) I have grep aliased to "grep --color=auto" as well, but that's a matter of formatting not function.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by