Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged url

Hide

News

2012-05-20 - test: test
2012-05-20 - test: test
2012-05-20 - test: test
2012-05-20 - Test tweets: YU not working?

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands tagged url

Terminal - Commands tagged url - 12 results

curl $URL -s -L -o /dev/null -w '%{url_effective}'

2012-01-25 16:11:24

User: labynocle

Tags: curl redirect url

Up
Down

Retrieve the final URL after redirect

Sometimes it could be very useful to obtain the final URL you'll use after several redirects.

(I use this command line for my automated tests to check if every redirections are ok)

tpb() { wget -U Mozilla -qO - $(echo "http://thepiratebay.org/search/$@/0/7/0" | sed 's/ /\%20/g') | grep -o 'http\:\/\/torrents\.thepiratebay\.org\/.*\.torrent' | tac; }

2011-10-26 12:15:55

User: Bonster

Functions: echo grep sed wget

Tags: bash download api url torrent torrents pirate thepiratebay piratebay ash

Up
Down

ThePirateBay.org torrent search

usage: tpb searchterm

example: tpb the matrix trilogy

This searches for torrents from thepiratebay and displays the top results in reverse order,

so the 1st result is at the bottom instead of the top -- which is better for command line users

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

isgd () { curl 'http://is.gd/create.php?format=simple&url='"$1" ; printf "\n" }

2011-08-14 23:31:39

User: dbbolton

Functions: printf

Tags: curl shorturl url

Up
Down

Generate a shortened URL with is.gd

Check the API. You shouldn't need sed. The print-newline at the end is to prevent zsh from inserting a % after the end-of-output.

Also works with http://v.gd

wget -U Mozilla -qO - "http://thepiratebay.org/search/your_querry_here/0/7/0" | grep -o 'http\:\/\/torrents\.thepiratebay\.org\/.*\.torrent'

2011-04-15 15:01:16

User: sairon

Functions: grep wget

Tags: bash download api url torrent torrents pirate thepiratebay piratebay ash

Up
Down

ThePirateBay.org torrent search

This one-liner greps first 30 direct URLs for .torrent files matching your search querry, ordered by number of seeds (descending; determined by the second number after your querry, in this case 7; for other options just check the site via your favorite web-browser).

You don't have to care about grepping the torrent names as well, because they are already included in the .torrent URL (except for spaces and some other characters replaced by underscores, but still human-readable).

Be sure to have some http://isup.me/ macro handy (someone often kicks the ethernet cables out of their servers ;) ).

I've also coded a more user-friendly ash (should be BASH compatible) script, which also lists the total size of download and number of seeds/peers (available at http://saironiq.blogspot.com/2011/04/my-shell-scripts-4-thepiratebayorg.html - may need some tweaking, as it was written for a router running OpenWrt and transmission).

Happy downloading!

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for file in `cat urls.txt`; do echo -n "$file " >> log.txt; curl --head $file >> log.txt ; done

2010-10-19 02:54:13

User: Glutnix

Functions: echo file

Tags: status log curl HEAD http files list download http_code url

-1

Up
Down

Get all the HTTP HEAD responses from a list of urls in a file

urls.txt should have a fully qualified url on each line

prefix with

rm log.txt;

to clear the log

change curl command to

curl --head $file | head -1 >> log.txt

to just get the http status

googl () { curl -s -d "url=${1}" http://goo.gl/api/url | sed -n "s/.*:\"$[^\"]*$.*/\1\n/p" ;}

2010-10-03 02:52:44

User: dabom

Functions: sed

Tags: sed curl google url google shortener

Up
Down

Google URL shortener

Shorter and made into a function.

curl -s -d'&url=URL' http://goo.gl/api/url | sed -e 's/{"short_url":"//' -e 's/","added_to_history":false}/\n/'

2010-10-01 23:20:08

User: Soubsoub

Functions: sed

Tags: sed curl google url google shortener

Up
Down

Google URL shortener

Use curl and sed to shorten an URL using goo.gl without any other api

curl -s 'http://ggl-shortener.appspot.com/?url='"$1" | sed -e 's/{"short_url":"//' -e 's/"}/\n/g'

2010-03-26 22:31:06

User: mvrilo

Functions: sed

Tags: sed curl google short url url

Up
Down

Google URL shortener

use curl and sed to shorten an url via goo.gl

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

curl -s "http://is.gd/api.php?longurl=[long_url]"

2009-12-07 18:52:04

User: Josso

Tags: short url shorturl url

-1

Up
Down

Shorten url with is.gd using curl, perl

// This is description for the old command:

Unfortunately we to encode the URL.

It can't be done with bash (without building it ourselves) so I used Perl?

Example with Perl:

curl -s http://is.gd/api.php?longurl=`perl -MURI::Escape -e "print uri_escape('http://www.google.com/search?hl=en&source=hp&q=commandlinefu&aq=0&oq=commandline');"`

Example without Perl:

curl http://is.gd/api.php?longurl=http://www.google.com

Most urls doesn't use & and ? anymore (SEO etc) so in most cases you can just use the simple version. :)

egrep 'https?://([[:alpha:]]([-[:alnum:]]+[[:alnum:]])*\.)+[[:alpha:]]{2,3}(:\d+)?(/([-\w/_\.]*(\?\S+)?)?)?'

2009-11-28 15:41:42

User: putnamhill

Functions: egrep

Tags: regex url match url matching

Up
Down

Match a URL

For the record: I didn't build this. Just shared what I found that worked. Apologies to the original author!

I decided I should fix the case where http://example.com is not matched for the next time I need this. So I read rfc1035 and formalized the host name regex.

If anyone finds any more holes, please comment.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cho "(Something like http://foo.com/blah_blah)" | awk '{for(i=1;i<=NF;i++){if($i~/^(http|ftp):\/\//)print $i}}'

2009-11-28 03:31:41

User: unixmonkey7109

Functions: awk

Tags: perl regex url match url matching

-1

Up
Down

Match a URL

don't have to be that complicated

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

echo "(Something like http://foo.com/blah_blah)" | grep -oP "\b(([\w-]+://?|www[.])[^\s()<>]+(?:$[\w\d]+$|([^[:punct:]\s]|/)))"

2009-11-28 00:41:57

User: matthewbauer

Functions: echo grep

Tags: perl regex url match url matching

Up
Down

Match a URL

From http://daringfireball.net/2009/11/liberal_regex_for_matching_urls

Thought it would be useful to commandlinefuers.