Commands using wget sorted by votes

Commands using wget (286)

sorted by

grep BTC last trading price from BTC-E, but u can change it.. they got em all

Show Sample Output
This is sample output - yours may be different.
```
719.00
```
0

wget -q -O- http://bitinfocharts.com/markets/btc-e/btc-usd.html |grep -o -P 'lastTrade">([0-9]{1,})(.){0,1}[0-9]{0,}' |grep -o -P '(\d)+(\.){0,1}(\d)*' |head -n 1

peter1337 · 2014-01-25 23:40:00 22
Download German word pronounciation as mp3 file
This is sample output - yours may be different.
0

for w in [WORT1] [WORTn]; do wget -O $w.mp3 $(wget -O - "http://www.duden.de/rechtschreibung/$w" | grep -o "http://www.duden.de/_media_/audio/[^\.]*\.mp3"); done

nk23x1 · 2014-04-11 20:03:30 7
Get own public IP address

This is the command line I use to get my IP address in order to update my zoneedit account. Full script on my blog http://akim.sissaoui.com/linux-attitude/script-de-mise-a-jour-ddns-zoneedit-com-en-bashsh/ Show Sample Output
This is sample output - yours may be different.
```
82.146.xxx.xxx
```
0

$ wget --no-check-certificate -q checkip.dyndns.org -O index.html && cat index.html|cut -d ' ' -f 6 | cut -d '<' -f 1

Superkikim · 2014-05-12 07:10:29 9
Display a quote of the day in notification bubble

Just pulls a quote for each day and displays it in a notification bubble... or you can change it a bit and just have it run in the terminal wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g'; rm -f quote Show Sample Output
This is sample output - yours may be different.
```
As he caught his footing, his head fell back, and the Milky Way flowed down inside him with a roar.
    Yasunari Kawabata,
-OR-
```
0

wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;notify-send "$(echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g')"; rm -f quote

nowhereman88 · 2014-06-15 03:17:19 62
wget
This is sample output - yours may be different.
0

wget www.google.com

xiruizhifu · 2014-07-04 12:49:37 57
Get all files with a certain extension linked to on a page

Change *.ext to the appropriate extension
This is sample output - yours may be different.
0

wget -r -nd -q -A "*.ext" http://www.example.org/

phracker · 2014-07-04 18:28:07 8
Git autocomplete

Downloads this raw script https://github.com/git/git/blob/master/contrib/completion/git-completion.bash from Github, copies it to your home directory, autoloads it in ~/.bashrc and sources it.
This is sample output - yours may be different.
0

wget https://raw.githubusercontent.com/git/git/master/contrib/completion/git-completion.bash; mv git-completion.bash ~/.git-completion.bash; echo "source ~/.git-completion.bash" > ~/.bashrc; source ~/.git-completion.bash

servel333 · 2014-07-22 14:21:00 22
Spoof your wget referring url
This is sample output - yours may be different.
0

H="--header"; wget $H="Accept-Language: en-us,en;q=0.5" $H="Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" $H="Connection: keep-alive" -U "Mozilla/5.0 (Windows NT 5.1; rv:10.0.2) Gecko/20100101 Firefox/10.0.2" --referer=urlhere

theabarnes · 2014-10-17 04:22:07 9
Get your external IP address

Easiest way to get the external IP address.
This is sample output - yours may be different.
0

echo $(wget http://ipecho.net/plain -q -O -)

KonKar · 2014-10-25 20:25:05 13
oracle-java install with one line ( prompt for sudo if needed)
This is sample output - yours may be different.
0

wget http://www.duinsoft.nl/pkg/pool/all/update-sun-jre.bin && sh ./update-sun-jre.bin

dbiesecke · 2014-11-06 19:00:59 12
check broken links using wget as a spider

This command crawls a domain with the typical WGET output. It logs every thing to a WGET-LOG file with any errors repeated at the end. It also had the added benefit of not flooding your terminal without ouput, so it is safe to run in the background.
This is sample output - yours may be different.
0

wget --spider -nd -e robots=off -prb -o wget-log -nv http://example.com

anEffingChamp · 2015-01-08 16:14:19 9

Fetches NOAA text product weather data. (US only)

The only requirement to make this work is some research on what your local NOAA "zone" is. One place to take a look is: http://www.nws.noaa.gov/mirs/public/prods/maps/pfzones_list.htm Show Sample Output

wget -q -O - http://weather.noaa.gov/pub/data/observations/state_roundup/ny/nyz003.txt http://weather.noaa.gov/pub/data/forecasts/zone/ny/nyz003.txt | less

nanoscript · 2015-01-17 05:09:05 8

Run bash script from web

Use this command to execute the contents of http://www.example.com/automation/remotescript.sh in the local environment. The parameters are optional. Alterrnatives to wget: CURL: curl -s http://www.example.com/automation/remotescript.sh | bash /dev/stdin param1 param2 W3M: w3m -dump http://www.example.com/automation/remotescript.sh | bash /dev/stdin [param1] [param2] LYNX: lynx -source http://www.example.com/automation/remotescript.sh | bash /dev/stdin [param1] [param2]
This is sample output - yours may be different.
0

wget -q -O - http://www.example.com/automation/remotescript.sh | bash /dev/stdin parameter1 parameter2

paulera · 2015-02-16 16:55:09 17
Resume a download
This is sample output - yours may be different.
0

wget -c [URL]

nmgcl · 2015-09-14 16:38:03 22
Global BTC rate in EUR

Returns the global weighted BTC rate in EUR. Requires the "jq" JSON parser. Show Sample Output
This is sample output - yours may be different.
```
BTC rate is 213.53 ?
```
0

echo "BTC rate is" $(wget https://api.bitcoinaverage.com/ticker/global/EUR/ -q -O - | jq ".last") "?"

lordtoran · 2015-09-28 23:03:59 13
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 25
Random Wallpaper From Reddit
This is sample output - yours may be different.
0

wget -O - http://www.reddit.com/r/wallpaper | grep -Eo 'http://i.imgur.com[^&]+jpg' | shuf -n 1 | xargs wget -O background.jpg ; feh --bg-fill background.jpg

lowrez · 2015-12-22 19:11:02 23
4chan image batch downloader

Replace thread_link with the link of the thread you want to download images of.
This is sample output - yours may be different.
0

wget thread_link -qO - | sed 's/\ /\n/g' | grep -e png -e jpg | grep href | sed 's/href\=\"/http:/g' | sed 's/"//g' | uniq | xargs wget

hztrance · 2016-07-16 20:43:33 13
Make mirror of ftp directory
This is sample output - yours may be different.
0

wget -m --ftp-user=root --ftp-password=pass -A "*.csv" -nd -P "dirname" ftp://46.46.46.46/../mnt/sd/

swarzynski · 2016-08-31 10:59:07 3075
Get all files of particular type (say, mp3) listed on some web page (say, audio.org)

Get all files of particular type (say, mp3) listed on some web page (say, audio.org)
This is sample output - yours may be different.
0

wget -c -r --no-parent -A .mp3 http://audio.org/mp3s/

bhishma · 2016-12-31 22:38:22 17
Download just html of a whole website

--mirror >>> all pages --random-wait >>> makes it look like not a bot --recursive >>> all pages, follow links ? robots=off >>> ignore no robots request -U mozilla >>> makes it look like real user on a browser not commandline -R >>> reject these file types we only want html -c >>>continue. In case you had to stop the wget you can pick it right back up! --reject-regex '((.*)\?(.*))|(.*)' >>> skip urls with parameters (don't download the same page a million times -
This is sample output - yours may be different.
0

wget --mirror --random-wait --recursive robots=off -U mozilla -R gif,jpg,pdf --reject-regex '((.*)\?(.*))|(.*)' -c [URLGOESHERE]

shwaydogg · 2017-01-05 02:12:59 15
download whole website localls with wget mirroring

mirroring / copy whole website for offline use localls with wget
This is sample output - yours may be different.
0

wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-names=windows --domains website.tld http://www.website.tld

aysadk · 2017-01-26 14:21:25 20
Download first mp3 file linked in a RSS feed
This is sample output - yours may be different.
0

wget `curl -s <podcast feed URL> | grep -o 'https*://[^"]*mp3' | head -1`

tbon3r · 2017-07-16 23:02:03 26
Download an entire website
This is sample output - yours may be different.
0

wget -mkEpnp example.com

prabhakaran9397 · 2017-08-05 19:45:03 160
Export all Stremio movie names

I couldn't find movie library on any of the SQLlite Stremio databases, but on ~/.config/stremio/backgrounds2 the background image filenames corresponds to IMDB URL. So I foreach files and wget HTML title of each movie and save it to a file. This will retrieve all movie names, not just the Library.
This is sample output - yours may be different.
0

time for movie in $(ls -1 $HOME/.config/stremio/backgrounds2 | sort -u);do echo "https://www.imdb.com/title/$movie/" | wget -qO- -O- -i- --header="Accept-Language: en" | hxclean | hxselect -s '\n' -c 'title' 2>/dev/null | tee -a ~/movie-list.txt ; done

pabloab · 2018-08-16 06:11:41 479
‹ First < 7 8 9 10 11 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Add all files not under subversion control

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Download all images on a 4chan thread

Start dd and show progress every X seconds

Adjust "sleep X" to your needs. *NOTE: First sleep is required because bash doesn't have a "post-test" syntax (do XXX while).

unbuffered tcpdump

Sometimes the question comes up: How to get unbuffered tcpdump output into the next program in the pipe? i.e. if your OS forces you to wait for the buffer to fill before the next program sees any of the output If you use -Uw- then you can't use -A (or -X or -XX) at the same time. When the question comes up, I've never seen anyone suggest this simple solution: chaining 2 tcpdump instances.

Delete all but the latest 5 files, ignoring directories

Monitor system load and print out top offending processes

This checks the system load every second and if it's over a certain threshold (.8 in this example), it spits out the date, system loads and top 4 processes sorted by CPU. Additionally, the \a in the first echo creates an audible bell.

How to backup hard disk timely?

Creates files in $DATE and hardlinks existing files to $PREVDATE. Thus full backup in each directory. Only drawback is changed modification time. Recommend a wrapper script to determine $DATE and $PREVDATE. Works like a charm. (Dirvish handrolled)

ram usage most top 10 process

Browse system RAM in a human readable form

This command lets you see and scroll through all of the strings that are stored in the RAM at any given time. Press space bar to scroll through to see more pages (or use the arrow keys etc). Sometimes if you don't save that file that you were working on or want to get back something you closed it can be found floating around in here! The awk command only shows lines that are longer than 20 characters (to avoid seeing lots of junk that probably isn't "human readable"). If you want to dump the whole thing to a file replace the final '| less' with '> memorydump'. This is great for searching through many times (and with the added bonus that it doesn't overwrite any memory...). Here's a neat example to show up conversations that were had in pidgin (will probably work after it has been closed)... $sudo cat /proc/kcore | strings | grep '([0-9]\{2\}:[0-9]\{2\}:[0-9]\{2\})' (depending on sudo settings it might be best to run $sudo su first to get to a # prompt)

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Commands using wget (286) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using wget (286)

sorted by