Commands tagged curl sorted by votes

Commands tagged curl (213)

sorted by

get a list of top 1000 sites from alexa

this will dump a list of domains one per line into a text file
This is sample output - yours may be different.
-2

curl -s -O http://s3.amazonaws.com/alexa-static/top-1m.csv.zip ; unzip -q -o top-1m.csv.zip top-1m.csv ; head -1000 top-1m.csv | cut -d, -f2 | cut -d/ -f1 > topsites.txt

chrismccoy · 2010-11-01 01:25:53 5
download a list of urls
This is sample output - yours may be different.
-2

cat urls.txt | xargs -n1 curl -O --max-time 10 --retry 3 --retry-delay 1

kev · 2012-05-14 06:38:06 5
Get external IP address (supports IPv4 and IPv6)

ip.telize.com (Listen on both IPv4 and IPv6) ip4.telize.com (Listen on IPv4 only) ip6.telize.com (Listen on IPv6 only) More information on : http://www.telize.com
This is sample output - yours may be different.
-2

curl ip.telize.com

fcambus · 2014-02-04 12:25:52 8
Get your external IP address

If curl isn't available, use lynx.
This is sample output - yours may be different.
-3

lynx --dump icanhazip.com

111110100 · 2010-06-16 11:52:50 4
See where a shortened url takes you before click

We can put this inside a function: fxray() { curl -s http://urlxray.com/display.php?url="$1" | grep -o '<title>.*</title>' | sed 's/<title>.*--> $.*$<\/title>/\1/g'; }; fxray http://tinyurl.com/demo-xray Show Sample Output
This is sample output - yours may be different.
```
http://urlxray.com/sex-so-hot-it-will-blow-your-mind.php

(Note: this result is totally SFW)
```
-3

curl -s http://urlxray.com/display.php?url=http://tinyurl.com/demo-xray | grep -o '<title>.*</title>' | sed 's/<title>.*--> $.*$<\/title>/\1/g'

karpoke · 2010-09-30 10:25:18 5
Get the browser user-agent

That's useful when you're doing some web scraping http://en.wikipedia.org/wiki/Web_scraping and you're trying to test your possibly fake user-agent. Show Sample Output
This is sample output - yours may be different.
```
curl/7.22.0 (x86_64-unknown-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.0e zlib/1.2.5 libssh2/1.3.0
```
-3

curl sputnick-area.net/ua

sputnick · 2011-10-24 09:57:50 4
Get your external IP address

Another simple way to get external IP or use: wget -qO- http://ipecho.net/plain
This is sample output - yours may be different.
-3

curl http://ipecho.net/plain

maxwelleite · 2013-02-20 14:14:19 6
download file1 file2 file3 file4 .... file 100

With counter format [001, 002, ..., 999] , nice with pictures or wallpapers collections.
This is sample output - yours may be different.
-4

for file in $(seq -f '%03.f' 1 $TOTAL ); do echo "($file/$TOTAL)"; curl -f -O http://domain.com/Name_$file.ext; done

nordri · 2010-01-12 15:23:44 7
View the newest xkcd comic.

Add an alias to your .bashrc that allows you to issue the command xkcd to view (with gwenview) the newest xkcd comic... I know there are thousands of them out there but this one is at least replete with installer and also uses a more concise syntax... plus, gwenview shows you the downloading progress as it downloads the comic and gives you a more full featured viewing experience.
This is sample output - yours may be different.
-5

echo alias xkcd="gwenview `w3m -dump http://xkcd.com/|grep png | awk '{print $5}'` 2> /dev/null" >> .bashrc

GinoMan2440 · 2010-01-30 20:38:16 6
Post to twitter via curl, Windows version

Aside from curl one will need iconv windows binary since windows lacks a native utf-8 cli interface. In my case I need a proxy in China and iconv to convert gbk status string into utf-8. GnuWin32 is a good choice with loads of coreutils natively ported to Windows "FOR /f" is the solution to pass iconv output to curl.
This is sample output - yours may be different.
-5

FOR /f %%g in ('echo %1 ^| iconv -f gbk -t utf-8') DO curl -x proxy:port -u user:pass -d status=%%g -d source="cURL" http://twitter.com/statuses/update.xml

MeaCulpa · 2010-07-21 04:53:54 4
View the newest xkcd comic.

KISS To get a random xkcd comic: xdg-open http://dynamic.xkcd.com/random/comic/
This is sample output - yours may be different.
-5

xdg-open http://xkcd.com/

unixmonkey8024 · 2010-08-25 19:14:11 4
download a specific file

download a specific file with -f to not display errors and -O to write output to a file named as the remote file. Show Sample Output
This is sample output - yours may be different.
```
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
 11 1621M   11  192M    0     0  1003k      0  0:27:34  0:03:16  0:24:18 1119k
```
-7

curl -f -O http://pcbsd.fastbull.org/7.0.2/i386/PCBSD7.0.2-x86-DVD.iso

battavia · 2009-04-26 07:23:31 13
Facebook Email Scraper
This is sample output - yours may be different.
-15

fbemailscraper YourFBEmail Password

coast · 2010-05-26 20:52:29 6
‹ First < 7 8 9

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

download newest adminer and rename to it's version accordingly

If the version already downloaded. it will not download again

ps -ef | grep PROCESS | grep -v grep | awk '{print $2}' | xargs kill -9

kills all pids matching the search term of "PROCESS". Be careful what you wish for :)

Bypass 1000 Entry limit of Active Directory with ldapsearch

That command bypass the entry limit specifing page results size, when the search arrive to the limit ldapsearch magically reiterate it from the last entry.

Delete recursively only empty folders on present dir

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

list block devices

Shows all block devices in a tree with descruptions of what they are.

How to extract 5000 records from each table in MySQL

How to extract data from one table: mysqldump --opt --where="true LIMIT 5000" dbinproduzione tabella > miodbditest_tabella.sql

Random unsigned integer

Find artist and title of a music cd, UPC code given (first result only)

I like curl better than wget, I just think that curl -s is a lot simpler than wget ... see I forget what you even have to do to get wget to pipe it's output Anyway, all in one sed command as "requested"

How to secure delete a file

Instead, install apt-get install secure-delete and you can use: -- srm to delete file and directory on hard disk -- smem to delete file in RAM -- sfill to delete "free space" on hard disk -- sswap to delete all data from swap

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged curl

Commands tagged curl (213) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged curl (213)

sorted by