Commands tagged curl sorted by votes

Commands tagged curl (213)

sorted by

get daily wizard of id comic

Requires the date command. This also works with some other comics. Here's a bash script that displays daily Garfield, Id, and Andy Capp: http://putnamhill.net/cgi-bin/yahoo-comics.sh?ga,crwiz,crcap
This is sample output - yours may be different.
0

curl -o id.gif `date +http://d.yimg.com/a/p/uc/%Y%m%d/largeimagecrwiz%y%m%d.gif`

putnamhill · 2009-12-04 20:16:32 4
List your Boxee queue

Might be able to do it in less steps with xmlstarlet, although whether that would end up being shorter overall I don't know - xmlstarlet syntax confuses the heck out of me. Prompts for your password, or if you're a bit mental you can add your password into the command itself in the format "-u user:password". Show Sample Output
This is sample output - yours may be different.
```
queued  Youtube video
queued  TEDTalks : The amazing intelligence of crows - Joshua Klein
queued  The Fresh Prince of the Dark Side Pranks Christian TV
queued  Grand Theft Auto: Chinatown Wars
queued  Flight of the Conchords Ep 6 Bret, You've got it Going On
```
0

curl -u <username> http://app.boxee.tv/api/get_queue | xml2 | grep /boxeefeed/message/description | awk -F= '{print $2}'

Strawp · 2010-01-20 16:17:19 551
Get the state (HTTP code) of a resource from its URL
This is sample output - yours may be different.
0

curl -s -L --head -w "%{http_code}\n" URL | tail -n1

tokland · 2010-04-02 19:42:14 7
Play 2600 off the hook over ssh

Ever wanted to stream your favorite podcast across the network, well now you can. This command will parse the iTunes enabled podcast and stream the latest episode across the network through ssh encryption. Show Sample Output
This is sample output - yours may be different.
```
High Preformance MPEG 1.0/2.0/2.5 Audio Player for Layer 1, 2 and 3.
Version 0.59s-mh4 (2000/Oct/27). Written and copyrights by Michael Hipp.
Uses code from various people. See 'README' for more!
THIS SOFTWARE COMES WITH ABSOLUTELY NO WARRANTY! USE AT YOUR OWN RISK!

Playing MPEG stream from standard input ...
Found new ID3 Header
MPEG 2.0 layer III, 64 kbit/s, 22050 Hz joint-stereo
```
0

curl -L -s `curl -s http://www.2600.com/oth-broadband.xml` | xmlstarlet sel -t -m "//enclosure[1]" -v "@url" -n | head -n 1` | ssh -t [user]@[host] "mpg123 -"

denzuko · 2010-07-30 23:20:50 4
Play a podcast via XPath and mpg123

Gets the latest podcast show from from your favorite Podcast. Uses curl and xmlstarlet. Make sure you change out the items between brackets.
This is sample output - yours may be different.
0

curl -L -s `curl -s [http://podcast.com/show.rss]` | xmlstarlet sel -t -m "//enclosure[1]" -v "@url" -n | head -n 1` | ssh -t [user]@[host] "mpg123 -"

denzuko · 2010-07-31 00:17:47 4
command line fu roulette

Splitting on tags in awk is a handy way to parse html.
This is sample output - yours may be different.
0

curl -sL 'www.commandlinefu.com/commands/random' | awk -F'</?[^>]+>' '/"command"/{print $2}'

putnamhill · 2010-08-13 11:42:42 6
View the newest xkcd comic.

This function displays the latest comic from xkcd.com. One of the best things about xkcd is the title text when you hover over the comic, so this function also displays that after you close the comic. To get a random xkcd comic use the following: xkcdrandom() { wget -qO- http://dynamic.xkcd.com/comic/random | sed -n 's#^<img src="$http://imgs.[^"]\+$"\s\+title="$.\+\?$"\salt.\+$#eog "\1"\necho '"'\2'#p" | bash; } These are just a bit shorter than the ones eigthmillion wrote, however his version didn't work as expected on my laptop for some reason (I got the title-tag first), so these build a command which is executed by bash.
This is sample output - yours may be different.
0

xkcd() { wget -qO- http://xkcd.com/ | sed -n 's#^<img src="$http://imgs.[^"]\+$"\s\+title="$.\+\?$"\salt.\+$#eog "\1"\necho '"'\2'#p" | bash ; }

John_W · 2010-08-25 15:44:31 7
Bulk add urls to your Instapaper account

Note, you need to replace the email address with your private Instapaper email address. There are a bunch of possible improvements such as, - Not writing a temp file - Doesnt strip tags (tho Instapaper does thankfully) - Shouldnt require 2 curls
This is sample output - yours may be different.
0

for url in `cat urls `; do title=`curl $url 2>&1 | grep -i '<title>.*</title>'` && curl $url > /tmp/u && mail -s "$title" your-private-instapaper-address@instapaper.com < /tmp/u ; done

iamarchimedes · 2010-10-16 19:10:19 5
find co-ordinates of a location

Just a few minor changes. First the usage of lynx instead of curl so no sed is needed to revert the spaces. Then the usages of egrep instead of grep -e to save a few characters and last the removal of the extra 0. Show Sample Output
This is sample output - yours may be different.
```
$ : distance 1600 Pennsylvania Avenue, Washington D.C
Full Address: 1600 Pennsylvania Ave NW, Washington D.C., DC 20500, USA,
coordinates: [ -77.0365191, 38.8976964 ]
```
0

findlocation() {place=`echo $@`; lynx -dump "http://maps.google.com/maps/geo?output=json&oe=utf-8&q=$place" | egrep "address|coordinates" | sed -e 's/^ *//' -e 's/"//g' -e 's/address/Full Address/';}

houghi · 2010-10-18 21:59:26 5

this simply curls the feed and runs a xpath query on it ... Show Sample Output

atomtitles () { curl --silent $1 | xmlstarlet sel -N atom="http://www.w3.org/2005/Atom" -t -m /atom:feed/atom:entry -v atom:title -n}

Seebi · 2010-12-15 11:03:31 7

Find artist and title of a music cd, UPC code given (first result only)

Changed wget to curl and it doesn't create a file anymore. Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
0

curl http://www.discogs.com/search?q=724349691704 2> /dev/null | grep \/release\/ | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/'

mrman · 2011-01-30 23:45:50 4
YouTube Convert and Download All User's Videos to MP3s on the fly

yt2mp3(){ for j in `seq 1 301`;do i=`curl -s gdata.youtube.com/feeds/api/users/$1/uploads\?start-index=$j\&max-results=1|grep -o "watch[^&]*"`;ffmpeg -i `wget youtube.com/$i -qO-|grep -o 'url_map"[^,]*'|sed -n '1{s_.*|__;s_\\\__g;p}'` -vn -ab 128k "`youtube-dl -e ${i#*=}`.mp3";done;} squeezed the monster (and nifty ☺) command from 7776 from 531 characters to 284 characters, but I don't see a way to get it down to 255. This is definitely a kludge!
This is sample output - yours may be different.
0

Command in description (Your command is too long - please keep it to less than 255 characters)

__ · 2011-02-03 08:25:42 6
Download 40 top funnyjunk Images to the current directory

If your version of curl does not support the --compressed option, use curl -s http://funnyjunk.com | gunzip instead of curl -s --compressed http://funnyjunk.com
This is sample output - yours may be different.
0

curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget

laniner · 2011-07-21 15:57:21 7
Check if your webserver supports gzip compression with curl
This is sample output - yours may be different.
0

if curl -s -I -H "Accept-Encoding: gzip,deflate" http://example.com/ | grep 'Content-Encoding: gzip' >/dev/null 2>&1 ; then echo Yes; else echo No;fi

rwky · 2011-08-16 21:48:14 4
Print the lastest stable version of Perl
This is sample output - yours may be different.
0

curl -s http://www.perl.org/get.html | grep -m1 '\.tar\.gz' | sed 's/.*perl-//; s/\.tar\.gz.*//'

dbbolton · 2011-08-19 23:33:49 4
OSX Expand URL and Copy to Clipboard

Expand a URL, aka do a head request, and get the URL. Copy this value to clipboard.
This is sample output - yours may be different.
0

function expand_url() { curl -sI $1 | grep Location: | cut -d " " -f 2 | tr -d "\n" | pbcopy }

gt · 2011-08-21 05:30:09 4
Get your external IP address

JSON version. Additionally it may give your geolocation if it's known by hostip.info Show Sample Output
This is sample output - yours may be different.
```
{
 "host": {
  "ipv4": "188.165.241.33",
  "hostname": "ns390090.ovh.net",
  "address": {
    "city":"Roubaix",
    "country":"FRANCE (FR)",
    "geo": {
     "latitude":50.7,
     "longitude":3.1667
   }
  }
 }
}
```
0

curl http://my-ip.cc/host.json

samleb · 2011-09-01 00:31:49 4
Expand shortened URLs

This shell function uses curl(1) as it is more portable than wget(1) across Unices, to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. It is a refinement to www.commandlinefu.com/commands/view/9515/expand-shortened-urls to make it better for use in scripts. Only displays final result. expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
https://wiki.ubuntu.com/UbuntuOpenWeek
```
0

expandurl() { curl -sIL $1 2>&1 | awk '/^Location/ {print $2}' | tail -n1; }

defiantredpill · 2011-10-19 01:35:33 5
save login cookie
This is sample output - yours may be different.
0

curl -c cookie.txt -d username=hello -d password=w0r1d http://www.site.com/login

kev · 2011-11-09 02:57:39 4
send cookie
This is sample output - yours may be different.
0

curl -b cookie.txt http://www.site.com/download/file.txt

kev · 2011-11-09 03:00:49 5
batch download jpgs which are in sequence
This is sample output - yours may be different.
0

curl -O http://www.site.com/img/image[001-175].jpg

kev · 2011-11-09 10:19:24 5
Get your external public IP address

Grabs your external public IP. Show Sample Output
This is sample output - yours may be different.
```
xxx.xxx.xx.xx
```
0

curl icanhazip.com

o0110o · 2011-11-15 19:57:01 10
Retrieve the final URL after redirect

Sometimes it could be very useful to obtain the final URL you'll use after several redirects. (I use this command line for my automated tests to check if every redirections are ok) Show Sample Output
This is sample output - yours may be different.
```
$ curl http://google.com -s -L -o /dev/null -w '%{url_effective}'
http://www.google.fr/
```
0

curl $URL -s -L -o /dev/null -w '%{url_effective}'

labynocle · 2012-01-25 16:11:24 5

Output the latest linux kernel versions from kernel.org

Gets the (previously obtainable with: finger @kernel.org ) info of the latest linux kernel versions available. Show Sample Output

curl 'https://www.kernel.org/kdist/finger_banner'

Testuser_01 · 2012-03-04 21:10:19 5

Get IP address from Tor exit-node

Reciprocally, we could get the node name from a give Tor IP address => ip2node() { curl -s -d "QueryIP=$1" http://torstatus.blutmagie.de/tor_exit_query.php | grep -oP "Server name:.*'>\K\w+" ; } ip2node 204.8.156.142 BostonUCompSci Show Sample Output
This is sample output - yours may be different.
```
#: ip2node() { curl -s -d "QueryIP=$1" http://torstatus.blutmagie.de/tor_exit_query.php | grep -oP "Server name:.*'>\K\w+" ; }

#: ip2node 204.8.156.142

#: BostonUCompSci
```
0

curl -s -d "CSField=Name" -d "CSInput=BostonUCompSci" http://torstatus.blutmagie.de/index.php | grep -oP "ip=\K(\d+)(\.\d+){3}"

JisSey · 2012-03-09 16:52:27 4
‹ First < 4 5 6 7 8 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Get line number 12 (or n) from a file

Extracts only file number 12 from file. It's meant for text files. Replace 12 with the number you want. First line starts at 1 not 0. We use q on next line so doesn't process any line more.

Never rewrites a file while copying (or moving)

Allows you to preserve your files when using cp, mv, ln, install or patch. When the target file exists, it will generate a file named XXX.~N~ (N is an auto-incremental number) instead of deleting the target file.

Quick and dirty RSS

runs an rss feed through sed replacing the closing tags with newlines and the opening tags with white space making it readable.

ROT13 whole file in vim.

gg puts the cursor at the begin g? ROT13 until the next mov G the EOF

Another Curl your IP command

Just another curl command to get your public facing IP

underscore to camelCase

Kills a process that is locking a file.

Useful when you're trying to unmount a volume and other sticky situations where a rogue process is annoying the hell out of you.

Buffer in order to avoir mistakes with redirections that empty your files

A common mistake in Bash is to write command-line where there's command a reading a file and whose result is redirected to that file. It can be easily avoided because of : 1) warnings "-bash: file.txt: cannot overwrite existing file" 2) options (often "-i") that let the command directly modify the file but I like to have that small function that does the trick by waiting for the first command to end before trying to write into the file. Lots of things could probably done in a better way, if you know one...

See how many more processes are allowed, awesome!

There is a limit to how many processes you can run at the same time for each user, especially with web hosts. If the maximum # of processes for your user is 200, then the following sets OPTIMUM_P to 100. $ OPTIMUM_P=$(( (`ulimit -u` - `find /proc -maxdepth 1 $ -user $USER -o -group $GROUPNAME $ -type d|wc -l`) / 2 )) This is very useful in scripts because this is such a fast low-resource-intensive (compared to ps, who, lsof, etc) way to determine how many processes are currently running for whichever user. The number of currently running processes is subtracted from the high limit setup for the account (see limits.conf, pam, initscript). An easy to understand example- this searches the current directory for shell scripts, and runs up to 100 'file' commands at the same time, greatly speeding up the command. $ find . -type f | xargs -P $OPTIMUM_P -iFNAME file FNAME | sed -n '/shell script text/p' I am using it in my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html especially for the xargs command. Xargs has a -P option that lets you specify how many processes to run at the same time. For instance if you have 1000 urls in a text file and wanted to download all of them fast with curl, you could download 100 at a time (check ps output on a separate [pt]ty for proof) like this: $ cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}' I like to do things as fast as possible on my servers. I have several types of servers and hosting environments, some with very restrictive jail shells with 20processes limit, some with 200, some with 8000, so for the jailed shells my xargs -P10 would kill my shell or dump core. Using the above I can set the -P value dynamically, so xargs always works, like this. $ cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}' If you were building a process-killer (very common for cheap hosting) this would also be handy. Note that if you are only allowed 20 or so processes, you should just use -P1 with xargs.

Happy New Year!

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged curl

Commands tagged curl (213) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged curl (213)

sorted by