Commands tagged curl sorted by votes

Commands tagged curl (212)

sorted by

List your Boxee queue

Might be able to do it in less steps with xmlstarlet, although whether that would end up being shorter overall I don't know - xmlstarlet syntax confuses the heck out of me. Prompts for your password, or if you're a bit mental you can add your password into the command itself in the format "-u user:password". Show Sample Output
This is sample output - yours may be different.
```
queued  Youtube video
queued  TEDTalks : The amazing intelligence of crows - Joshua Klein
queued  The Fresh Prince of the Dark Side Pranks Christian TV
queued  Grand Theft Auto: Chinatown Wars
queued  Flight of the Conchords Ep 6 Bret, You've got it Going On
```
0

curl -u <username> http://app.boxee.tv/api/get_queue | xml2 | grep /boxeefeed/message/description | awk -F= '{print $2}'

Strawp · 2010-01-20 16:17:19 547
Get the state (HTTP code) of a resource from its URL
This is sample output - yours may be different.
0

curl -s -L --head -w "%{http_code}\n" URL | tail -n1

tokland · 2010-04-02 19:42:14 6
Play 2600 off the hook over ssh

Ever wanted to stream your favorite podcast across the network, well now you can. This command will parse the iTunes enabled podcast and stream the latest episode across the network through ssh encryption. Show Sample Output
This is sample output - yours may be different.
```
High Preformance MPEG 1.0/2.0/2.5 Audio Player for Layer 1, 2 and 3.
Version 0.59s-mh4 (2000/Oct/27). Written and copyrights by Michael Hipp.
Uses code from various people. See 'README' for more!
THIS SOFTWARE COMES WITH ABSOLUTELY NO WARRANTY! USE AT YOUR OWN RISK!

Playing MPEG stream from standard input ...
Found new ID3 Header
MPEG 2.0 layer III, 64 kbit/s, 22050 Hz joint-stereo
```
0

curl -L -s `curl -s http://www.2600.com/oth-broadband.xml` | xmlstarlet sel -t -m "//enclosure[1]" -v "@url" -n | head -n 1` | ssh -t [user]@[host] "mpg123 -"

denzuko · 2010-07-30 23:20:50 3
Play a podcast via XPath and mpg123

Gets the latest podcast show from from your favorite Podcast. Uses curl and xmlstarlet. Make sure you change out the items between brackets.
This is sample output - yours may be different.
0

curl -L -s `curl -s [http://podcast.com/show.rss]` | xmlstarlet sel -t -m "//enclosure[1]" -v "@url" -n | head -n 1` | ssh -t [user]@[host] "mpg123 -"

denzuko · 2010-07-31 00:17:47 3
command line fu roulette

Splitting on tags in awk is a handy way to parse html.
This is sample output - yours may be different.
0

curl -sL 'www.commandlinefu.com/commands/random' | awk -F'</?[^>]+>' '/"command"/{print $2}'

putnamhill · 2010-08-13 11:42:42 5
View the newest xkcd comic.

This function displays the latest comic from xkcd.com. One of the best things about xkcd is the title text when you hover over the comic, so this function also displays that after you close the comic. To get a random xkcd comic use the following: xkcdrandom() { wget -qO- http://dynamic.xkcd.com/comic/random | sed -n 's#^<img src="$http://imgs.[^"]\+$"\s\+title="$.\+\?$"\salt.\+$#eog "\1"\necho '"'\2'#p" | bash; } These are just a bit shorter than the ones eigthmillion wrote, however his version didn't work as expected on my laptop for some reason (I got the title-tag first), so these build a command which is executed by bash.
This is sample output - yours may be different.
0

xkcd() { wget -qO- http://xkcd.com/ | sed -n 's#^<img src="$http://imgs.[^"]\+$"\s\+title="$.\+\?$"\salt.\+$#eog "\1"\necho '"'\2'#p" | bash ; }

John_W · 2010-08-25 15:44:31 6
Bulk add urls to your Instapaper account

Note, you need to replace the email address with your private Instapaper email address. There are a bunch of possible improvements such as, - Not writing a temp file - Doesnt strip tags (tho Instapaper does thankfully) - Shouldnt require 2 curls
This is sample output - yours may be different.
0

for url in `cat urls `; do title=`curl $url 2>&1 | grep -i '<title>.*</title>'` && curl $url > /tmp/u && mail -s "$title" your-private-instapaper-address@instapaper.com < /tmp/u ; done

iamarchimedes · 2010-10-16 19:10:19 4
find co-ordinates of a location

Just a few minor changes. First the usage of lynx instead of curl so no sed is needed to revert the spaces. Then the usages of egrep instead of grep -e to save a few characters and last the removal of the extra 0. Show Sample Output
This is sample output - yours may be different.
```
$ : distance 1600 Pennsylvania Avenue, Washington D.C
Full Address: 1600 Pennsylvania Ave NW, Washington D.C., DC 20500, USA,
coordinates: [ -77.0365191, 38.8976964 ]
```
0

findlocation() {place=`echo $@`; lynx -dump "http://maps.google.com/maps/geo?output=json&oe=utf-8&q=$place" | egrep "address|coordinates" | sed -e 's/^ *//' -e 's/"//g' -e 's/address/Full Address/';}

houghi · 2010-10-18 21:59:26 3

this simply curls the feed and runs a xpath query on it ... Show Sample Output

atomtitles () { curl --silent $1 | xmlstarlet sel -N atom="http://www.w3.org/2005/Atom" -t -m /atom:feed/atom:entry -v atom:title -n}

Seebi · 2010-12-15 11:03:31 6

Find artist and title of a music cd, UPC code given (first result only)

Changed wget to curl and it doesn't create a file anymore. Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
0

curl http://www.discogs.com/search?q=724349691704 2> /dev/null | grep \/release\/ | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/'

mrman · 2011-01-30 23:45:50 3
YouTube Convert and Download All User's Videos to MP3s on the fly

yt2mp3(){ for j in `seq 1 301`;do i=`curl -s gdata.youtube.com/feeds/api/users/$1/uploads\?start-index=$j\&max-results=1|grep -o "watch[^&]*"`;ffmpeg -i `wget youtube.com/$i -qO-|grep -o 'url_map"[^,]*'|sed -n '1{s_.*|__;s_\\\__g;p}'` -vn -ab 128k "`youtube-dl -e ${i#*=}`.mp3";done;} squeezed the monster (and nifty ☺) command from 7776 from 531 characters to 284 characters, but I don't see a way to get it down to 255. This is definitely a kludge!
This is sample output - yours may be different.
0

Command in description (Your command is too long - please keep it to less than 255 characters)

__ · 2011-02-03 08:25:42 5
Download 40 top funnyjunk Images to the current directory

If your version of curl does not support the --compressed option, use curl -s http://funnyjunk.com | gunzip instead of curl -s --compressed http://funnyjunk.com
This is sample output - yours may be different.
0

curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget

laniner · 2011-07-21 15:57:21 6
Check if your webserver supports gzip compression with curl
This is sample output - yours may be different.
0

if curl -s -I -H "Accept-Encoding: gzip,deflate" http://example.com/ | grep 'Content-Encoding: gzip' >/dev/null 2>&1 ; then echo Yes; else echo No;fi

rwky · 2011-08-16 21:48:14 3
Print the lastest stable version of Perl
This is sample output - yours may be different.
0

curl -s http://www.perl.org/get.html | grep -m1 '\.tar\.gz' | sed 's/.*perl-//; s/\.tar\.gz.*//'

dbbolton · 2011-08-19 23:33:49 3
OSX Expand URL and Copy to Clipboard

Expand a URL, aka do a head request, and get the URL. Copy this value to clipboard.
This is sample output - yours may be different.
0

function expand_url() { curl -sI $1 | grep Location: | cut -d " " -f 2 | tr -d "\n" | pbcopy }

gt · 2011-08-21 05:30:09 3
Get your external IP address

JSON version. Additionally it may give your geolocation if it's known by hostip.info Show Sample Output
This is sample output - yours may be different.
```
{
 "host": {
  "ipv4": "188.165.241.33",
  "hostname": "ns390090.ovh.net",
  "address": {
    "city":"Roubaix",
    "country":"FRANCE (FR)",
    "geo": {
     "latitude":50.7,
     "longitude":3.1667
   }
  }
 }
}
```
0

curl http://my-ip.cc/host.json

samleb · 2011-09-01 00:31:49 3
Expand shortened URLs

This shell function uses curl(1) as it is more portable than wget(1) across Unices, to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. It is a refinement to www.commandlinefu.com/commands/view/9515/expand-shortened-urls to make it better for use in scripts. Only displays final result. expandurl http://t.co/LDWqmtDM Show Sample Output
This is sample output - yours may be different.
```
https://wiki.ubuntu.com/UbuntuOpenWeek
```
0

expandurl() { curl -sIL $1 2>&1 | awk '/^Location/ {print $2}' | tail -n1; }

defiantredpill · 2011-10-19 01:35:33 4
save login cookie
This is sample output - yours may be different.
0

curl -c cookie.txt -d username=hello -d password=w0r1d http://www.site.com/login

kev · 2011-11-09 02:57:39 3
send cookie
This is sample output - yours may be different.
0

curl -b cookie.txt http://www.site.com/download/file.txt

kev · 2011-11-09 03:00:49 4
batch download jpgs which are in sequence
This is sample output - yours may be different.
0

curl -O http://www.site.com/img/image[001-175].jpg

kev · 2011-11-09 10:19:24 4
Get your external public IP address

Grabs your external public IP. Show Sample Output
This is sample output - yours may be different.
```
xxx.xxx.xx.xx
```
0

curl icanhazip.com

o0110o · 2011-11-15 19:57:01 9
Retrieve the final URL after redirect

Sometimes it could be very useful to obtain the final URL you'll use after several redirects. (I use this command line for my automated tests to check if every redirections are ok) Show Sample Output
This is sample output - yours may be different.
```
$ curl http://google.com -s -L -o /dev/null -w '%{url_effective}'
http://www.google.fr/
```
0

curl $URL -s -L -o /dev/null -w '%{url_effective}'

labynocle · 2012-01-25 16:11:24 4

Output the latest linux kernel versions from kernel.org

Gets the (previously obtainable with: finger @kernel.org ) info of the latest linux kernel versions available. Show Sample Output

curl 'https://www.kernel.org/kdist/finger_banner'

Testuser_01 · 2012-03-04 21:10:19 4

Get IP address from Tor exit-node

Reciprocally, we could get the node name from a give Tor IP address => ip2node() { curl -s -d "QueryIP=$1" http://torstatus.blutmagie.de/tor_exit_query.php | grep -oP "Server name:.*'>\K\w+" ; } ip2node 204.8.156.142 BostonUCompSci Show Sample Output
This is sample output - yours may be different.
```
#: ip2node() { curl -s -d "QueryIP=$1" http://torstatus.blutmagie.de/tor_exit_query.php | grep -oP "Server name:.*'>\K\w+" ; }

#: ip2node 204.8.156.142

#: BostonUCompSci
```
0

curl -s -d "CSField=Name" -d "CSInput=BostonUCompSci" http://torstatus.blutmagie.de/index.php | grep -oP "ip=\K(\d+)(\.\d+){3}"

JisSey · 2012-03-09 16:52:27 3
Print trending topics on Twitter

Prints top 5 twitter topics. Not very well written at all but none of the others worked.
This is sample output - yours may be different.
0

curl -s mobile.twitter.com/search | sed -n '/trend_footer_list/,/\ul>/p' | awk -F\> '{print $3}' | awk -F\< '{print $1}' | sed '/^$/d'

articmonkey · 2012-03-15 17:17:06 3
‹ First < 4 5 6 7 8 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Sed can refference parts of the pattern in the replacement:

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Copy a MySQL Database to a new Server via SSH with one command

Dumps a MySQL database over a compressed SSH tunnel and uses it as input to mysql - i think that is the fastest and best way to migrate a DB to a new server!

Remote screenshot

Say if you're logged into a remote system via ssh and this system has an x window system, but yet you still want a screen shot of what's going on graphically. This will do it for you. :-)

Display the human-readable sizes of all files and folders in the current directory with 3 decimal places

To sort the list by file/directory size, insert `sort -n |` before `awk`.

Find usb device

I often use it to find recently added ou removed device, or using find in /dev, or anything similar. Just run the command, plug the device, and wait to see him and only him

Follow tail by name (fix for rolling logs with tail -f)

If you use 'tail -f foo.txt' and it becomes temporarily moved/deleted (ie: log rolls over) then tail will not pick up on the new foo.txt and simply waits with no output. 'tail -F' allows you to follow the file by it's name, rather than a descriptor. If foo.txt disappears, tail will wait until the filename appears again and then continues tailing.

Find all videos under current directory using MIME a.k.a not using extension

Videos are found using their MIME type. Thus no need to for an extension for the video file. This is a efficent version of "jnash" cmd (4086). Thanks for jnash. This cmd will only show video files while his cmd show files having "video" anywhere in path.

get partitions that are over 50% usage

add all files not under version control to repository

This should handle whitespaces well and will not get confused if your filenames have "?" in them

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged curl

Commands tagged curl (212) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged curl (212)

sorted by