Commands using wget sorted by votes

Commands using wget (286)

sorted by

grep BTC last trading price from BTC-E, but u can change it.. they got em all

Show Sample Output
This is sample output - yours may be different.
```
719.00
```
0

wget -q -O- http://bitinfocharts.com/markets/btc-e/btc-usd.html |grep -o -P 'lastTrade">([0-9]{1,})(.){0,1}[0-9]{0,}' |grep -o -P '(\d)+(\.){0,1}(\d)*' |head -n 1

peter1337 · 2014-01-25 23:40:00 20
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

for w in [WORT1] [WORTn]; do wget -O $w.mp3 $(wget -O - "http://www.duden.de/rechtschreibung/$w" | grep -o "http://www.duden.de/_media_/audio/[^\.]*\.mp3"); done

nk23x1 · 2014-04-11 20:03:30 6
Get own public IP address

This is the command line I use to get my IP address in order to update my zoneedit account. Full script on my blog http://akim.sissaoui.com/linux-attitude/script-de-mise-a-jour-ddns-zoneedit-com-en-bashsh/ Show Sample Output
This is sample output - yours may be different.
```
82.146.xxx.xxx
```
0

$ wget --no-check-certificate -q checkip.dyndns.org -O index.html && cat index.html|cut -d ' ' -f 6 | cut -d '<' -f 1

Superkikim · 2014-05-12 07:10:29 8
Display a quote of the day in notification bubble

Just pulls a quote for each day and displays it in a notification bubble... or you can change it a bit and just have it run in the terminal wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g'; rm -f quote Show Sample Output
This is sample output - yours may be different.
```
As he caught his footing, his head fell back, and the Milky Way flowed down inside him with a roar.
    Yasunari Kawabata,
-OR-
```
0

wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;notify-send "$(echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g')"; rm -f quote

nowhereman88 · 2014-06-15 03:17:19 61
wget
This is sample output - yours may be different.
0

wget www.google.com

xiruizhifu · 2014-07-04 12:49:37 56
Get all files with a certain extension linked to on a page

Change *.ext to the appropriate extension
This is sample output - yours may be different.
0

wget -r -nd -q -A "*.ext" http://www.example.org/

phracker · 2014-07-04 18:28:07 7
Git autocomplete

Downloads this raw script https://github.com/git/git/blob/master/contrib/completion/git-completion.bash from Github, copies it to your home directory, autoloads it in ~/.bashrc and sources it.
This is sample output - yours may be different.
0

wget https://raw.githubusercontent.com/git/git/master/contrib/completion/git-completion.bash; mv git-completion.bash ~/.git-completion.bash; echo "source ~/.git-completion.bash" > ~/.bashrc; source ~/.git-completion.bash

servel333 · 2014-07-22 14:21:00 21
Spoof your wget referring url
This is sample output - yours may be different.
0

H="--header"; wget $H="Accept-Language: en-us,en;q=0.5" $H="Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" $H="Connection: keep-alive" -U "Mozilla/5.0 (Windows NT 5.1; rv:10.0.2) Gecko/20100101 Firefox/10.0.2" --referer=urlhere

theabarnes · 2014-10-17 04:22:07 8
Get your external IP address

Easiest way to get the external IP address.
This is sample output - yours may be different.
0

echo $(wget http://ipecho.net/plain -q -O -)

KonKar · 2014-10-25 20:25:05 11
oracle-java install with one line ( prompt for sudo if needed)
This is sample output - yours may be different.
0

wget http://www.duinsoft.nl/pkg/pool/all/update-sun-jre.bin && sh ./update-sun-jre.bin

dbiesecke · 2014-11-06 19:00:59 9
check broken links using wget as a spider

This command crawls a domain with the typical WGET output. It logs every thing to a WGET-LOG file with any errors repeated at the end. It also had the added benefit of not flooding your terminal without ouput, so it is safe to run in the background.
This is sample output - yours may be different.
0

wget --spider -nd -e robots=off -prb -o wget-log -nv http://example.com

anEffingChamp · 2015-01-08 16:14:19 8

Fetches NOAA text product weather data. (US only)

The only requirement to make this work is some research on what your local NOAA "zone" is. One place to take a look is: http://www.nws.noaa.gov/mirs/public/prods/maps/pfzones_list.htm Show Sample Output

wget -q -O - http://weather.noaa.gov/pub/data/observations/state_roundup/ny/nyz003.txt http://weather.noaa.gov/pub/data/forecasts/zone/ny/nyz003.txt | less

nanoscript · 2015-01-17 05:09:05 7

Run bash script from web

Use this command to execute the contents of http://www.example.com/automation/remotescript.sh in the local environment. The parameters are optional. Alterrnatives to wget: CURL: curl -s http://www.example.com/automation/remotescript.sh | bash /dev/stdin param1 param2 W3M: w3m -dump http://www.example.com/automation/remotescript.sh | bash /dev/stdin [param1] [param2] LYNX: lynx -source http://www.example.com/automation/remotescript.sh | bash /dev/stdin [param1] [param2]
This is sample output - yours may be different.
0

wget -q -O - http://www.example.com/automation/remotescript.sh | bash /dev/stdin parameter1 parameter2

paulera · 2015-02-16 16:55:09 16
Resume a download
This is sample output - yours may be different.
0

wget -c [URL]

nmgcl · 2015-09-14 16:38:03 19
Global BTC rate in EUR

Returns the global weighted BTC rate in EUR. Requires the "jq" JSON parser. Show Sample Output
This is sample output - yours may be different.
```
BTC rate is 213.53 ?
```
0

echo "BTC rate is" $(wget https://api.bitcoinaverage.com/ticker/global/EUR/ -q -O - | jq ".last") "?"

lordtoran · 2015-09-28 23:03:59 13
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 24
Random Wallpaper From Reddit
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpaper | grep -Eo 'http://i.imgur.com[^&]+jpg' | shuf -n 1 | xargs wget -O background.jpg ; feh --bg-fill background.jpg

lowrez · 2015-12-22 19:11:02 21
4chan image batch downloader

Replace thread_link with the link of the thread you want to download images of.
This is sample output - yours may be different.
0

wget thread_link -qO - | sed 's/\ /\n/g' | grep -e png -e jpg | grep href | sed 's/href\=\"/http:/g' | sed 's/"//g' | uniq | xargs wget

hztrance · 2016-07-16 20:43:33 12
Make mirror of ftp directory
This is sample output - yours may be different.
0

wget -m --ftp-user=root --ftp-password=pass -A "*.csv" -nd -P "dirname" ftp://46.46.46.46/../mnt/sd/

swarzynski · 2016-08-31 10:59:07 3010
Get all files of particular type (say, mp3) listed on some web page (say, audio.org)

Get all files of particular type (say, mp3) listed on some web page (say, audio.org)
This is sample output - yours may be different.
0

wget -c -r --no-parent -A .mp3 http://audio.org/mp3s/

bhishma · 2016-12-31 22:38:22 14
Download just html of a whole website

--mirror >>> all pages --random-wait >>> makes it look like not a bot --recursive >>> all pages, follow links ? robots=off >>> ignore no robots request -U mozilla >>> makes it look like real user on a browser not commandline -R >>> reject these file types we only want html -c >>>continue. In case you had to stop the wget you can pick it right back up! --reject-regex '((.*)\?(.*))|(.*)' >>> skip urls with parameters (don't download the same page a million times -
This is sample output - yours may be different.
0

wget --mirror --random-wait --recursive robots=off -U mozilla -R gif,jpg,pdf --reject-regex '((.*)\?(.*))|(.*)' -c [URLGOESHERE]

shwaydogg · 2017-01-05 02:12:59 15
download whole website localls with wget mirroring

mirroring / copy whole website for offline use localls with wget
This is sample output - yours may be different.
0

wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-names=windows --domains website.tld http://www.website.tld

aysadk · 2017-01-26 14:21:25 17
Download first mp3 file linked in a RSS feed
This is sample output - yours may be different.
0

wget `curl -s <podcast feed URL> | grep -o 'https*://[^"]*mp3' | head -1`

tbon3r · 2017-07-16 23:02:03 25
Download an entire website
This is sample output - yours may be different.
0

wget -mkEpnp example.com

prabhakaran9397 · 2017-08-05 19:45:03 155
Export all Stremio movie names

I couldn't find movie library on any of the SQLlite Stremio databases, but on ~/.config/stremio/backgrounds2 the background image filenames corresponds to IMDB URL. So I foreach files and wget HTML title of each movie and save it to a file. This will retrieve all movie names, not just the Library.
This is sample output - yours may be different.
0

time for movie in $(ls -1 $HOME/.config/stremio/backgrounds2 | sort -u);do echo "https://www.imdb.com/title/$movie/" | wget -qO- -O- -i- --header="Accept-Language: en" | hxclean | hxselect -s '\n' -c 'title' 2>/dev/null | tee -a ~/movie-list.txt ; done

pabloab · 2018-08-16 06:11:41 320
‹ First < 7 8 9 10 11 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

a function to find the fastest DNS server

http://public-dns.info gives a list of online dns servers. you need to change the country in url (br in this url) with your country code. this command need some time to ping all IP in list.

More precise BASH debugging

Find the files that contain a certain term

Simple use of find and grep to recursively search a directory for files that contain a certain term.

tar the current directory wihtout the absolute path

tars the current directory (and its children) in an archive of the same name (plus ".tar" :)) in the parent directory without the absolute path, so that when the archive is extracted, only the current directory name is created for the path. Assumes bash/zsh.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Check a directory of PNG files for errors

Useful for checking if a large number of PNG files was downloaded successfully by verifying the built-in CRC checksum. For incomplete files, the command will print: "00002309.png EOF while reading IDAT data ERROR: 00002309.png" The process is very fast; checking 21,000 files of 5MB in size took only five minutes on a 2011 Intel mobile dual-core.

Grab the first 3 octets of your ip addresses

For machines that have many ip blocks spanning different Class C's, this will show which ones.

cpu and memory usage top 10 under Linux

The original version gives an error, here is the correct output

(Debian/Ubuntu) Discover what package a file belongs to

Works similar to dpkg -S, but uses the locatedb and is thus inarguably a lot faster - if the locatedb is current.

Find the 10 users that take up the most disk space

In OSX you would have to make sure that you "sudo -s" your way to happiness since it will give a few "Permission denied" errors before finally spitting out the results. In OSX the directory structure has to start with the "Users" Directory then it will recursively perform the operation. Your Lord and master, Mematron

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by