Commands tagged curl sorted by votes

Commands tagged curl (213)

sorted by

get a list of top 1000 sites from alexa

this will dump a list of domains one per line into a text file
This is sample output - yours may be different.
-2

curl -s -O http://s3.amazonaws.com/alexa-static/top-1m.csv.zip ; unzip -q -o top-1m.csv.zip top-1m.csv ; head -1000 top-1m.csv | cut -d, -f2 | cut -d/ -f1 > topsites.txt

chrismccoy · 2010-11-01 01:25:53 5
download a list of urls
This is sample output - yours may be different.
-2

cat urls.txt | xargs -n1 curl -O --max-time 10 --retry 3 --retry-delay 1

kev · 2012-05-14 06:38:06 5
Get external IP address (supports IPv4 and IPv6)

ip.telize.com (Listen on both IPv4 and IPv6) ip4.telize.com (Listen on IPv4 only) ip6.telize.com (Listen on IPv6 only) More information on : http://www.telize.com
This is sample output - yours may be different.
-2

curl ip.telize.com

fcambus · 2014-02-04 12:25:52 8
Get your external IP address

If curl isn't available, use lynx.
This is sample output - yours may be different.
-3

lynx --dump icanhazip.com

111110100 · 2010-06-16 11:52:50 4
See where a shortened url takes you before click

We can put this inside a function: fxray() { curl -s http://urlxray.com/display.php?url="$1" | grep -o '<title>.*</title>' | sed 's/<title>.*--> $.*$<\/title>/\1/g'; }; fxray http://tinyurl.com/demo-xray Show Sample Output
This is sample output - yours may be different.
```
http://urlxray.com/sex-so-hot-it-will-blow-your-mind.php

(Note: this result is totally SFW)
```
-3

curl -s http://urlxray.com/display.php?url=http://tinyurl.com/demo-xray | grep -o '<title>.*</title>' | sed 's/<title>.*--> $.*$<\/title>/\1/g'

karpoke · 2010-09-30 10:25:18 5
Get the browser user-agent

That's useful when you're doing some web scraping http://en.wikipedia.org/wiki/Web_scraping and you're trying to test your possibly fake user-agent. Show Sample Output
This is sample output - yours may be different.
```
curl/7.22.0 (x86_64-unknown-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.0e zlib/1.2.5 libssh2/1.3.0
```
-3

curl sputnick-area.net/ua

sputnick · 2011-10-24 09:57:50 4
Get your external IP address

Another simple way to get external IP or use: wget -qO- http://ipecho.net/plain
This is sample output - yours may be different.
-3

curl http://ipecho.net/plain

maxwelleite · 2013-02-20 14:14:19 6
download file1 file2 file3 file4 .... file 100

With counter format [001, 002, ..., 999] , nice with pictures or wallpapers collections.
This is sample output - yours may be different.
-4

for file in $(seq -f '%03.f' 1 $TOTAL ); do echo "($file/$TOTAL)"; curl -f -O http://domain.com/Name_$file.ext; done

nordri · 2010-01-12 15:23:44 7
View the newest xkcd comic.

Add an alias to your .bashrc that allows you to issue the command xkcd to view (with gwenview) the newest xkcd comic... I know there are thousands of them out there but this one is at least replete with installer and also uses a more concise syntax... plus, gwenview shows you the downloading progress as it downloads the comic and gives you a more full featured viewing experience.
This is sample output - yours may be different.
-5

echo alias xkcd="gwenview `w3m -dump http://xkcd.com/|grep png | awk '{print $5}'` 2> /dev/null" >> .bashrc

GinoMan2440 · 2010-01-30 20:38:16 6
Post to twitter via curl, Windows version

Aside from curl one will need iconv windows binary since windows lacks a native utf-8 cli interface. In my case I need a proxy in China and iconv to convert gbk status string into utf-8. GnuWin32 is a good choice with loads of coreutils natively ported to Windows "FOR /f" is the solution to pass iconv output to curl.
This is sample output - yours may be different.
-5

FOR /f %%g in ('echo %1 ^| iconv -f gbk -t utf-8') DO curl -x proxy:port -u user:pass -d status=%%g -d source="cURL" http://twitter.com/statuses/update.xml

MeaCulpa · 2010-07-21 04:53:54 4
View the newest xkcd comic.

KISS To get a random xkcd comic: xdg-open http://dynamic.xkcd.com/random/comic/
This is sample output - yours may be different.
-5

xdg-open http://xkcd.com/

unixmonkey8024 · 2010-08-25 19:14:11 4
download a specific file

download a specific file with -f to not display errors and -O to write output to a file named as the remote file. Show Sample Output
This is sample output - yours may be different.
```
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
 11 1621M   11  192M    0     0  1003k      0  0:27:34  0:03:16  0:24:18 1119k
```
-7

curl -f -O http://pcbsd.fastbull.org/7.0.2/i386/PCBSD7.0.2-x86-DVD.iso

battavia · 2009-04-26 07:23:31 13
Facebook Email Scraper
This is sample output - yours may be different.
-15

fbemailscraper YourFBEmail Password

coast · 2010-05-26 20:52:29 6
‹ First < 7 8 9

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

All IP connected to my host

find all computer connected to my host through TCP connection.

alias to close terminal with :q

Put this in your ~/.bashrc file (or the equivalent) If you use vim a lot, this alias will be immediately obvious. Your brain will thank you.

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Iterate through current directory + all subs for C++ header files and rank by # of comments

This shows you which files are most in need of commenting (one line of output per file)

Schedule a script or command in x num hours, silently run in the background even if logged out

This is helpful for shell scripts, I use it in my custom php install script to schedule to delete the build files in 3 hours, as the php install script is completely automated and is made to run slow. Does require at, which some environments without crontab still do have. You can add as many commands to the at you want. Here's how I delete them in case the script gets killed. (trapped) atq |awk '{print $1}'|xargs -iJ atrm J &>/dev/null

Display packages and versions on Debian/Ubuntu distrib

Need admin right to run dpkg-query

txt2html

Convert Text to HTML

Email someone if a web page has been updated.

A cronjob command line to email someone when a webpages homepage is updated.

find geographical location of an ip address

I save this to bin/iptrace and run "iptrace ipaddress" to get the Country, City and State of an ip address using the http://ipadress.com service. I add the following to my script to get a tinyurl of the map as well: URL=`lynx -dump http://www.ip-adress.com/ip_tracer/?QRY=$1|grep details|awk '{print $2}'` lynx -dump http://tinyurl.com/create.php?url=$URL|grep tinyurl|grep "19. http"|awk '{print $2}'

Set CDPATH to ease navigation

CDPATH tells the cd command to look in this colon-separated list of directories for your destination. My preferred order are 1) the current directory, specified by the empty string between the = and the first colon, 2) the parent directory (so that I can cd lib instead of cd ../lib), 3) my home directory, and 4) my ~/projects directory.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged curl

Commands tagged curl (213) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged curl (213)

sorted by