Commands tagged curl sorted by votes

Commands tagged curl (212)

sorted by

Run 10 curl commands in parallel via xargs

Useful for download mulitple files Show Sample Output
This is sample output - yours may be different.
```
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
```
0

NUM="10";seq ${NUM}|time xargs -I % -n1 -P${NUM} curl -sL ifconfig.co

wuseman1 · 2022-06-02 02:08:05 330

Start monitoring your server with a single curl command.

activate the first alert and the next ones are activated automatically. Show Sample Output

curl ping.gl

wuseman1 · 2022-10-15 13:24:45 869

use curl to resume a failed download

If you are downloading a big file (or even a small one) and the connection breaks or times out, use this command in order to RESUME the download where it failed, instead of having to start downloading from the beginning. This is a real win for downloading debian ISO images over a buggy DSL modem. Take the partially downloaded file and cat it into the STDIN of curl, as shown. Then use the "-C -" option followed by the URL of the file you were originally downloading. Show Sample Output
This is sample output - yours may be different.
```
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 17.1M  100 17.1M    0     0   746k      0  0:00:23  0:00:23 --:--:--  793k
```
-1

cat file-that-failed-to-download.zip | curl -C - http://www.somewhere.com/file-I-want-to-download.zip >successfully-downloaded.zip

linuxrawkstar · 2009-08-05 13:33:06 16
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
View the newest xkcd comic.

Same thing just a different way to get there. You will need lynx
This is sample output - yours may be different.
-1

lynx --dump --source http://www.xkcd.com | grep `lynx --dump http://www.xkcd.com | egrep '(png|jpg)'` | grep title | cut -d = -f2,3 | cut -d '"' -f2,4 | sed -e 's/"/|/g' | awk -F"|" ' { system("display " $1);system("echo "$2); } '

solarislackware · 2009-12-03 18:53:57 3
Use curl on Windows to bulk-download the Savitabhabhi Comic Strip (for Adults)

Bulk downloads the comic strip JPG files for the adult cartoon Savitabhabhi, storing each set in it's own folder. Requires manual removal of "non-image" files that maybe created because each series may differ in length. The command can be easily adapted for UNIX flavours. You need to have cURL in your path.
This is sample output - yours may be different.
-1

for /L %%x in (1,1,16) do mkdir %%x & curl -R -e http://www.kirtu.com -o %%x/#1.jpg http://www.kirtu.com/toon/content/sb%x/english/sb%x_en_[001-070].jpg

MyTechieself · 2009-12-08 15:01:16 8
Send web page by e-mail

This will send the web page at $u to recipient@example.com . To send the web page to oneself, recipient@example.com can be replaced by $(whoami) or $USER. The "charset" is UTF-8 here, but any alternative charset of your choice would work. `wget -O - -o /dev/null $u` may be considered instead of `curl $u` . On some systems the complete path to sendmail may be necessary, for instance /sys/pkg/libexec/sendmail/sendmail for some NetBSD.
This is sample output - yours may be different.
-1

{ u="http://twitter.com/commandlinefu"; echo "Subject: $u"; echo "Mime-Version: 1.0"; echo -e "Content-Type: text/html; charset=utf-8\n\n"; curl $u ; } | sendmail $USER

pascalvaucheret · 2010-02-24 04:18:30 5
Get your external IP address

Request all information about my IP address in xml format
This is sample output - yours may be different.
-1

curl ifconfig.me/all/xml

truemilk · 2010-04-21 20:45:17 3

View the newest xkcd comic.

Output the html from xkcd's index.html, filter out the html tags, and then view it in gwenview. Show Sample Output

-1

hunterm · 2010-08-24 22:21:51 4

View the newest xkcd comic.

Shorter version with curl and awk
This is sample output - yours may be different.
-1

eog `curl 'http://xkcd.com/' | awk -F "ng): |</h" '/embedding/{print $2}'`

dog · 2010-08-25 14:04:30 3
Add together the count of users from the international Linux Counter and the dudalibre.com counter.

The command was too long for the command box, so here it is: echo $(( `wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'` + `curl --silent http://www.dudalibre.com/gnulinuxcounter?lang=en | grep users | head -2 | tail -1 | sed 's/.*<strong>//g' | sed 's/<\/strong>.*//g'` )) This took me about an hour to do. It uses wget and curl because, dudalibre.com blocks wget, and wget worked nicely for me. Show Sample Output
This is sample output - yours may be different.
```
138362
```
-1

Check the Description below.

hunterm · 2010-10-07 04:22:32 3
Get all the HTTP HEAD responses from a list of urls in a file

urls.txt should have a fully qualified url on each line prefix with rm log.txt; to clear the log change curl command to curl --head $file | head -1 >> log.txt to just get the http status Show Sample Output
This is sample output - yours may be different.
```
==log.txt:==
/downloads HTTP/1.1 301 Moved Permanently
/downloads/ HTTP/1.1 404 Not Found
/downloads/downloads/press/logos.zip HTTP/1.1 200 OK
```
-1

for file in `cat urls.txt`; do echo -n "$file " >> log.txt; curl --head $file >> log.txt ; done

Glutnix · 2010-10-19 02:54:13 5
View the newest xkcd comic.

Just added view with the eog viewer.
This is sample output - yours may be different.
-1

wget -O xkcd_$(date +%y-%m-%d).png `lynx --dump http://xkcd.com/|grep png`; eog xkcd_$(date +%y-%m-%d).png

theanalyst · 2010-10-27 13:42:55 3
Get your external IP address

Additionally it may give your geolocation if it's known by hostip.info Show Sample Output
This is sample output - yours may be different.
```
ipv4: 188.165.241.33
hostname: ns390090.ovh.net
city: Roubaix
country: FRANCE (FR)
latitude: 50.7
longitude: 3.1667
```
-1

curl http://my-ip.cc/host.txt

samleb · 2011-09-01 00:28:49 3

Get your external IP address

XML version. Additionally it may give your geolocation if it's known by hostip.info Show Sample Output

-1

curl http://my-ip.cc/host.xml

samleb · 2011-09-01 00:30:03 3

Get Google PageRank

via http://pagerank.bz/
This is sample output - yours may be different.
-1

curl pagerank.bz/yourdomain.com

random · 2011-09-02 09:01:52 3
measure answer time of a web service

This uses curl to find out the access times of a web service Show Sample Output
This is sample output - yours may be different.
```
1. 13:54:15: real 0m0.393s
2. 13:54:21: real 0m0.053s
3. 13:54:28: real 0m0.678s
4. 13:54:34: real 0m0.166s
....
40. ...
```
-1

for i in {1..40};do echo -n $i. $(date +%H:%M:%S):\ ; (time curl 'http://ya.ru/' &> /dev/null) 2>&1|grep real;sleep 1;done

AntonyC · 2011-11-11 10:40:38 3
Get your external IP address
This is sample output - yours may be different.
-1

wget ifconfig.me/ip -q -O -

DamirX · 2011-11-30 08:30:35 3
check your up to date delicious links.

This commands queries the delicious api then runs the xml through xml2, grabs the urls cuts out the first two columns, passes through uniq to remove duplicates if any, and then goes into linkchecker who checks the links. the links go the blacklist in ~/.linkchecker/blacklist. please see the manual pages for further info peeps. I took me a few days to figure this one out. I how you enjoy it. Also don't run these api more then once a few seconds you can get banned by delicious see their site for info. ~updated for no recursive Show Sample Output
This is sample output - yours may be different.
```
1 http://www.jokosher.org/
1 http://www.learnopenoffice.org/calccontents.htm
1 http://ubcd4win.com/forum/index.php?showtopic=9630
1 http://212.182.0.171/dwww/
1 http://www.smarthomeforum.com/start/default.asp
1 http://www.sjrcc.edu/
1 http://curvedns.on2it.net/docs
1 http://www.smarthomeforum.com/
```
-1

curl -k https://Username:Password@api.del.icio.us/v1/posts/all?red=api | xml2| \grep '@href' | cut -d\= -f 2- | sort | uniq | linkchecker -r0 --stdin --complete -v -t 50 -F blacklist

bbelt16ag · 2013-05-04 17:43:21 8
Check your unread Gmail from the command line
This is sample output - yours may be different.
-1

mtr www.google.com

slu4aen · 2014-10-08 06:55:32 9
Check the current price of Bitcoin (jq version, defines a function)

The only pre-requisite is jq (and curl, obviously). The other version used grep, but jq is much more suited to JSON parsing than that. Show Sample Output
This is sample output - yours may be different.
```
$ btc USD
1 BTC = 232.0986 USD
$ btc GBP
1 BTC = 149.4399 GBP
```
-1

btc() { echo "1 BTC = $(curl -s https://api.coindesk.com/v1/bpi/currentprice/$1.json | jq .bpi.\"$1\".rate | tr -d \"\"\") $1"; }

benjabean1 · 2015-09-19 02:49:30 18
Get the weather forecast for the next 24 to 48 for your location.

you can use xmlstarlet to parse output instead of perl
This is sample output - yours may be different.
-2

curl -s http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}|xmlstarlet sel -E utf-8 -t -m //forecast/txt_forecast/forecastday -v fcttext -n

fanfani · 2010-04-13 22:14:48 3
Generate background office noise using Digg feeds and OSX.

Instead of having someone else read you the Digg headlines, Have OSX do it. Requires Curl+Sed+Say. This could probably be easily modified to use espeak for Linux.
This is sample output - yours may be different.
-2

IFS=`echo -en "\n\b"`; for i in $(curl http://feeds.digg.com/digg/container/technology/popular.rss | grep '<title>' | sed -e 's#<[^>]*>##g' | tail -n10); do echo $i; echo $i | sed 's/^/Did you hear about /g' | say; sleep 30; done

echosedawk · 2010-06-07 22:16:19 4
Get your external IP address

With a lolcat favicon if you access it from your browser Show Sample Output
This is sample output - yours may be different.
```
172.0.0.100
```
-2

curl icanhazip.com

pykler · 2010-06-14 18:47:11 3
get a list of top 1000 sites from alexa

this will dump a list of domains one per line into a text file
This is sample output - yours may be different.
-2

curl -s -O http://s3.amazonaws.com/alexa-static/top-1m.csv.zip ; unzip -q -o top-1m.csv.zip top-1m.csv ; head -1000 top-1m.csv | cut -d, -f2 | cut -d/ -f1 > topsites.txt

chrismccoy · 2010-11-01 01:25:53 4
‹ First < 6 7 8 9 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

FizzBuzz in Perl

Just another FizzBuzz in Perl.

One line Perl Script to determine the largest file sizes on a Linux Server

This one line Perl script will display the smallest to the largest files sizes in all directories on a server.

Get the SAN (subjectAltName) of a site's certificate.

Based on http://stackoverflow.com/questions/13127352/checking-alternative-names-for-a-san-ssl-cert Replace "facebook.com" with the desired hostname.

Network traffic on NICs in mbps without sar, iperf, etc...

Need output in mbps (bits) # ./bytes-second.sh eth0 eth0 interface maximum Speed: 1000Mb/s RX:12883212 TX:17402002 B/s | RX:98 TX:132 Mb/s RX:12371647 TX:17830111 B/s | RX:94 TX:136 Mb/s RX:12502750 TX:17860915 B/s | RX:95 TX:136 Mb/s

cd up a number of levels

Instead of typing "cd ../../.." you can type ".. 3". For extremely lazy typists, you can add this alias: alias ...=".. 2" ....=".. 3" - so now you can write just .... !!! NB the .. function needs to be "source"d or included in your startup scripts, perhaps .bashrc.

VIM version 7: edit in tabs

Edit the files, each in a separate tab. use gT and gt to move to the left- and right-tab, respectively. to add another tab while editing, type ':tabe filename'

Url Encode

Converts reserved characters in a URI to their percent encoded counterparts. Alternate python version: $ echo "$url" | python -c 'import sys,urllib;print urllib.quote(sys.stdin.read().strip())'

Download all images from a website in a single folder

let a cow tell you your fortune

check the status of 'dd' in progress (OS X)

While a dd is running in one terminal, open another and enter the while loop. The sample output will be displayed in the window running the dd and the while loop will exit when the dd is complete. It's possible that a "sudo" will need to be inserted before "pkill", depending on your setup, for example: $ while pgrep ^dd; do sudo pkill -INFO dd; sleep 10; done

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged curl

Commands tagged curl (212) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged curl (212)

sorted by