Commands using wget | commandlinefu.com

Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using wget

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Terminal - Commands using wget - 232 results

url="put_url_here";audio=$(youtube-dl -s -e $url);wget -q -O - `youtube-dl -g $url`| ffmpeg -i - -f mp3 -vn -acodec libmp3lame - > "$audio.mp3"

2011-11-15 19:09:52

User: o0110o

Functions: wget

Tags: youtube mp3

Up
Down

Convert Youtube videos to MP3

Make your own MP3s from Youtube videos.

wget -A mp3,mpg,mpeg,avi -r -l 3 http://www.site.com/

2011-11-09 10:06:07

User: kev

Functions: wget

Tags: wget

Up
Down

recursively walk down no more than three levels and grab any file with an extension of mp3, mpg, mpeg, or avi

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

tpb() { wget -U Mozilla -qO - $(echo "http://thepiratebay.org/search/$@/0/7/0" | sed 's/ /\%20/g') | grep -o 'http\:\/\/torrents\.thepiratebay\.org\/.*\.torrent' | tac; }

2011-10-26 12:15:55

User: Bonster

Functions: echo grep sed wget

Tags: bash download api url torrent torrents pirate thepiratebay piratebay ash

Up
Down

ThePirateBay.org torrent search

usage: tpb searchterm

example: tpb the matrix trilogy

This searches for torrents from thepiratebay and displays the top results in reverse order,

so the 1st result is at the bottom instead of the top -- which is better for command line users

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

geoip() { wget -qO - http://freegeoip.net/xml/$1 | sed '3,12!d;s/<//g;s/>/: /g;s/\/.*//g' ; }

2011-10-25 21:07:08

User: vando

Functions: sed wget

-1

Up
Down

geoip information

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -b http://dl.google.com/android/android-sdk_r14-linux.tgz

2011-10-19 21:55:25

User: zlemini

Functions: wget

Up
Down

background a wget download

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

expandurl() { wget -S $1 2>&1 | grep ^Location; }

2011-10-18 18:50:54

User: atoponce

Functions: grep wget

Tags: wget

Up
Down

Expand shortened URLs

This shell function uses wget(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from:

expandurl http://t.co/LDWqmtDM

wget -O - -q http://whatismyip.org/

2011-10-15 11:36:56

User: ztank1013

Functions: wget

-5

Up
Down

Get your external IP address

This just output your external IP, no extra characters at the end of line.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -qO - --post-data "data[Row][cripted]=1cb251ec0d568de6a929b520c4aed8d1" http://md5-decrypter.com/ | grep -A1 "Decrypted text" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

2011-10-13 03:48:54

User: samhagin

Functions: cut grep sed tail wget

Tags: md5

Up
Down

Decrypt MD5

Decrypt MD5 , replace 1cb251ec0d568de6a929b520c4aed8d1 with the MD5 string you want to decrypt

wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g'

2011-10-13 03:44:48

User: samhagin

Functions: cut grep sed tail wget

Tags: md5

Up
Down

Encrypt text to md5

Encrypt any text to MD5 , replace text with the string you want to convert to MD5

wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /'

2011-10-06 20:27:02

User: winsbe01

Functions: grep sed wget

Up
Down

AmazonMP3 Daily Deals

grabs and prints the AmazonMP3 daily album deal

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -nd -nH -r -A pdf -I library/mac/documentation/ http://developer.apple.com/library/mac/navigation/#section=Resource%20Types&topic=Reference

2011-10-02 04:56:25

User: GinoMan2440

Functions: wget

Tags: mac os x

-2

Up
Down

Get all the reference docs for OS X from Apples Developer Connection site

download every last pdf reference Doc from the Apple Developer Connection, takes a half hour on a fast connection. enjoy!

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget http://www.commandlinefu.com/commands/by/e7__7dal

2011-09-30 09:40:29

User: e7dal

Functions: wget

-2

Up
Down

dont forget commands of old profile

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wgetall () { wget -r -l2 -nd -Nc -A.$@ $@ }

2011-09-28 09:43:25

User: peterRepeater

Functions: wget

Tags: wget mp3 download file format

Up
Down

Download all files of a certain type with wget.

Recursively download all files of a certain type down to two levels, ignoring directory structure and local duplicates.

Usage:

wgetall mp3 http://example.com/download/

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget http://tools.web4host.net/versions.tmp --quiet -O - | grep PHPMYADMIN | sed 's/PHPMYADMIN=//' | cat

2011-09-22 04:11:44

User: wr8cr8

Functions: grep sed wget

-2

Up
Down

Get the latest version of phpMyAdmin

This is to get the latest version of phpMyAdmin to support scripts to download the latest version of the software if they want to automatically update.

p=$(echo "hello world, how r u?"|sed 's/ /+/g');wget -U Mozilla -q -O - "$@" translate.google.com/translate_tts?tl=en\&q=$p|mpg123 -

2011-09-19 23:06:15

User: jhansen

Functions: echo mpg123 sed wget

Tags: google google api speech text-to-speech text to speech

Up
Down

Google text-to-speech in mp3 format

same but redirecting to player and putting whaever text line.. works on my ubuntu machine ...

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O - -q http://www.chisono.it/ip.asp && echo

2011-09-18 15:38:02

User: scanepa

Functions: wget

-2

Up
Down

Get your public IP using chisono.it

The echo at the end is for pretty printing as the output is just the IP address without any html

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -O - -q http://checkip.dyndns.org/ | cut -d':' -f2 | cut -d'<' -f1| cut -c2-

2011-09-17 13:42:01

User: ztank1013

Functions: cut wget

Tags: wget ip address

-2

Up
Down

Check your ip public using dyndns.org

This is just a "cut" addicted variant of the previous unixmonkey24730 command...

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget http://checkip.dyndns.org/ -q -O - | grep -Eo '\<[[:digit:]]{1,3}(\.[[:digit:]]{1,3}){3}\>'

2011-09-17 12:51:06

User: unixmonkey24730

Functions: grep wget

Tags: wget ip address

-3

Up
Down

Check your ip public using dyndns.org

curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-

2011-09-10 19:21:13

User: kev

Functions: grep sort wget

Tags: wget

Up
Down

download all jpg in webpage

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

say() { wget -q -U Mozilla -O output.mp3 "http://translate.google.com/translate_tts?tl=en&q=$1"; gnome-terminal -x bash -c "totem output.mp3"; sleep 4; totem --quit;}

2011-09-07 19:48:53

User: totti

Functions: bash sleep wget

Tags: google say text to speech

Up
Down

Gets the english pronunciation of a phrase

No need to install additional packages

eg:

say hello

For multiword

say how+are+you

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -r -k -l 7 -p -E -nc http://site.com/

2011-08-20 10:16:06

User: realjkeee

Functions: wget

-4

Up
Down

скачать сайт

-r ? указывает на то, что нужно рекурсивно переходить по ссылкам на сайте, чтобы скачивать страницы.

-k ? используется для того, чтобы wget преобразовал все ссылки в скаченных файлах таким образом, чтобы по ним можно было переходить на локальном компьютере (в автономном режиме).

-p ? указывает на то, что нужно загрузить все файлы, которые требуются для отображения страниц (изображения, css и т.д.).

-l ? определяет максимальную глубину вложенности страниц, которые wget должен скачать (по умолчанию значение равно 5, в примере мы установили 7). В большинстве случаев сайты имеют страницы с большой степенью вложенности и wget может просто ?закопаться?, скачивая новые страницы. Чтобы этого не произошло можно использовать параметр -l.

-E ? добавлять к загруженным файлам расширение .html.

-nc ? при использовании данного параметра существующие файлы не будут перезаписаны. Это удобно, когда нужно продолжить загрузку сайта, прерванную в предыдущий раз.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget -q -O - http://www.perl.org/get.html | grep -m1 '\.tar\.gz' | sed 's/.*perl-//; s/\.tar\.gz.*//'

2011-08-19 23:38:10

User: dbbolton

Functions: grep sed wget

Tags: perl wget

-1

Up
Down

Print the lastest stable version of Perl

This uses wget instead of curl

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for i in `seq -w 1 50`; do wget --continue \ http://commandline.org.uk/images/posts/animal/$i.jpg; done

2011-08-19 20:06:16

User: totti

Functions: wget

Tags: wget seq download

Up
Down

Download a set of files that are numbered

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

$ wget --mirror -p --convert-links -P ./<LOCAL-DIR> <WEBSITE-URL>

2011-08-18 08:27:28

User: tkembo

Functions: wget

Up
Down

Download entire website for offline viewing

?mirror : turn on options suitable for mirroring.

-p : download all files that are necessary to properly display a given HTML page.

?convert-links : after the download, convert the links in document for local viewing.

-P ./LOCAL-DIR : save all the files and directories to the specified directory.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

wget http://somesite.com/somestream.pls; cvlc somestream.pls&sleep 5; rm somestream.pls*

2011-08-04 19:24:18

User: tomjrace

Functions: rm wget

-1

Up
Down

Play a stream and give back the shell

I wanted to play a song from the shell and get the shell back, I also dont want to store the file if it is not needed.

edit, not sure if I need to mention it... killall vlc to stop it

< 1 2 3 4 5 > Last ›