Commands tagged curl sorted by votes

Commands tagged curl (212)

sorted by

Run 10 curl commands in parallel via xargs

Useful for download mulitple files Show Sample Output
This is sample output - yours may be different.
```
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
xx.xxx.xxx.xx
```
0

NUM="10";seq ${NUM}|time xargs -I % -n1 -P${NUM} curl -sL ifconfig.co

wuseman1 · 2022-06-02 02:08:05 317

Start monitoring your server with a single curl command.

activate the first alert and the next ones are activated automatically. Show Sample Output

curl ping.gl

wuseman1 · 2022-10-15 13:24:45 868

use curl to resume a failed download

If you are downloading a big file (or even a small one) and the connection breaks or times out, use this command in order to RESUME the download where it failed, instead of having to start downloading from the beginning. This is a real win for downloading debian ISO images over a buggy DSL modem. Take the partially downloaded file and cat it into the STDIN of curl, as shown. Then use the "-C -" option followed by the URL of the file you were originally downloading. Show Sample Output
This is sample output - yours may be different.
```
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 17.1M  100 17.1M    0     0   746k      0  0:00:23  0:00:23 --:--:--  793k
```
-1

cat file-that-failed-to-download.zip | curl -C - http://www.somewhere.com/file-I-want-to-download.zip >successfully-downloaded.zip

linuxrawkstar · 2009-08-05 13:33:06 11
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
View the newest xkcd comic.

Same thing just a different way to get there. You will need lynx
This is sample output - yours may be different.
-1

lynx --dump --source http://www.xkcd.com | grep `lynx --dump http://www.xkcd.com | egrep '(png|jpg)'` | grep title | cut -d = -f2,3 | cut -d '"' -f2,4 | sed -e 's/"/|/g' | awk -F"|" ' { system("display " $1);system("echo "$2); } '

solarislackware · 2009-12-03 18:53:57 3
Use curl on Windows to bulk-download the Savitabhabhi Comic Strip (for Adults)

Bulk downloads the comic strip JPG files for the adult cartoon Savitabhabhi, storing each set in it's own folder. Requires manual removal of "non-image" files that maybe created because each series may differ in length. The command can be easily adapted for UNIX flavours. You need to have cURL in your path.
This is sample output - yours may be different.
-1

for /L %%x in (1,1,16) do mkdir %%x & curl -R -e http://www.kirtu.com -o %%x/#1.jpg http://www.kirtu.com/toon/content/sb%x/english/sb%x_en_[001-070].jpg

MyTechieself · 2009-12-08 15:01:16 8
Send web page by e-mail

This will send the web page at $u to recipient@example.com . To send the web page to oneself, recipient@example.com can be replaced by $(whoami) or $USER. The "charset" is UTF-8 here, but any alternative charset of your choice would work. `wget -O - -o /dev/null $u` may be considered instead of `curl $u` . On some systems the complete path to sendmail may be necessary, for instance /sys/pkg/libexec/sendmail/sendmail for some NetBSD.
This is sample output - yours may be different.
-1

{ u="http://twitter.com/commandlinefu"; echo "Subject: $u"; echo "Mime-Version: 1.0"; echo -e "Content-Type: text/html; charset=utf-8\n\n"; curl $u ; } | sendmail $USER

pascalvaucheret · 2010-02-24 04:18:30 5
Get your external IP address

Request all information about my IP address in xml format
This is sample output - yours may be different.
-1

curl ifconfig.me/all/xml

truemilk · 2010-04-21 20:45:17 3

View the newest xkcd comic.

Output the html from xkcd's index.html, filter out the html tags, and then view it in gwenview. Show Sample Output

-1

hunterm · 2010-08-24 22:21:51 4

View the newest xkcd comic.

Shorter version with curl and awk
This is sample output - yours may be different.
-1

eog `curl 'http://xkcd.com/' | awk -F "ng): |</h" '/embedding/{print $2}'`

dog · 2010-08-25 14:04:30 3
Add together the count of users from the international Linux Counter and the dudalibre.com counter.

The command was too long for the command box, so here it is: echo $(( `wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'` + `curl --silent http://www.dudalibre.com/gnulinuxcounter?lang=en | grep users | head -2 | tail -1 | sed 's/.*<strong>//g' | sed 's/<\/strong>.*//g'` )) This took me about an hour to do. It uses wget and curl because, dudalibre.com blocks wget, and wget worked nicely for me. Show Sample Output
This is sample output - yours may be different.
```
138362
```
-1

Check the Description below.

hunterm · 2010-10-07 04:22:32 3
Get all the HTTP HEAD responses from a list of urls in a file

urls.txt should have a fully qualified url on each line prefix with rm log.txt; to clear the log change curl command to curl --head $file | head -1 >> log.txt to just get the http status Show Sample Output
This is sample output - yours may be different.
```
==log.txt:==
/downloads HTTP/1.1 301 Moved Permanently
/downloads/ HTTP/1.1 404 Not Found
/downloads/downloads/press/logos.zip HTTP/1.1 200 OK
```
-1

for file in `cat urls.txt`; do echo -n "$file " >> log.txt; curl --head $file >> log.txt ; done

Glutnix · 2010-10-19 02:54:13 5
View the newest xkcd comic.

Just added view with the eog viewer.
This is sample output - yours may be different.
-1

wget -O xkcd_$(date +%y-%m-%d).png `lynx --dump http://xkcd.com/|grep png`; eog xkcd_$(date +%y-%m-%d).png

theanalyst · 2010-10-27 13:42:55 3
Get your external IP address

Additionally it may give your geolocation if it's known by hostip.info Show Sample Output
This is sample output - yours may be different.
```
ipv4: 188.165.241.33
hostname: ns390090.ovh.net
city: Roubaix
country: FRANCE (FR)
latitude: 50.7
longitude: 3.1667
```
-1

curl http://my-ip.cc/host.txt

samleb · 2011-09-01 00:28:49 3

Get your external IP address

XML version. Additionally it may give your geolocation if it's known by hostip.info Show Sample Output

-1

curl http://my-ip.cc/host.xml

samleb · 2011-09-01 00:30:03 3

Get Google PageRank

via http://pagerank.bz/
This is sample output - yours may be different.
-1

curl pagerank.bz/yourdomain.com

random · 2011-09-02 09:01:52 3
measure answer time of a web service

This uses curl to find out the access times of a web service Show Sample Output
This is sample output - yours may be different.
```
1. 13:54:15: real 0m0.393s
2. 13:54:21: real 0m0.053s
3. 13:54:28: real 0m0.678s
4. 13:54:34: real 0m0.166s
....
40. ...
```
-1

for i in {1..40};do echo -n $i. $(date +%H:%M:%S):\ ; (time curl 'http://ya.ru/' &> /dev/null) 2>&1|grep real;sleep 1;done

AntonyC · 2011-11-11 10:40:38 3
Get your external IP address
This is sample output - yours may be different.
-1

wget ifconfig.me/ip -q -O -

DamirX · 2011-11-30 08:30:35 3
check your up to date delicious links.

This commands queries the delicious api then runs the xml through xml2, grabs the urls cuts out the first two columns, passes through uniq to remove duplicates if any, and then goes into linkchecker who checks the links. the links go the blacklist in ~/.linkchecker/blacklist. please see the manual pages for further info peeps. I took me a few days to figure this one out. I how you enjoy it. Also don't run these api more then once a few seconds you can get banned by delicious see their site for info. ~updated for no recursive Show Sample Output
This is sample output - yours may be different.
```
1 http://www.jokosher.org/
1 http://www.learnopenoffice.org/calccontents.htm
1 http://ubcd4win.com/forum/index.php?showtopic=9630
1 http://212.182.0.171/dwww/
1 http://www.smarthomeforum.com/start/default.asp
1 http://www.sjrcc.edu/
1 http://curvedns.on2it.net/docs
1 http://www.smarthomeforum.com/
```
-1

curl -k https://Username:Password@api.del.icio.us/v1/posts/all?red=api | xml2| \grep '@href' | cut -d\= -f 2- | sort | uniq | linkchecker -r0 --stdin --complete -v -t 50 -F blacklist

bbelt16ag · 2013-05-04 17:43:21 8
Check your unread Gmail from the command line
This is sample output - yours may be different.
-1

mtr www.google.com

slu4aen · 2014-10-08 06:55:32 9
Check the current price of Bitcoin (jq version, defines a function)

The only pre-requisite is jq (and curl, obviously). The other version used grep, but jq is much more suited to JSON parsing than that. Show Sample Output
This is sample output - yours may be different.
```
$ btc USD
1 BTC = 232.0986 USD
$ btc GBP
1 BTC = 149.4399 GBP
```
-1

btc() { echo "1 BTC = $(curl -s https://api.coindesk.com/v1/bpi/currentprice/$1.json | jq .bpi.\"$1\".rate | tr -d \"\"\") $1"; }

benjabean1 · 2015-09-19 02:49:30 16
Get the weather forecast for the next 24 to 48 for your location.

you can use xmlstarlet to parse output instead of perl
This is sample output - yours may be different.
-2

curl -s http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}|xmlstarlet sel -E utf-8 -t -m //forecast/txt_forecast/forecastday -v fcttext -n

fanfani · 2010-04-13 22:14:48 3
Generate background office noise using Digg feeds and OSX.

Instead of having someone else read you the Digg headlines, Have OSX do it. Requires Curl+Sed+Say. This could probably be easily modified to use espeak for Linux.
This is sample output - yours may be different.
-2

IFS=`echo -en "\n\b"`; for i in $(curl http://feeds.digg.com/digg/container/technology/popular.rss | grep '<title>' | sed -e 's#<[^>]*>##g' | tail -n10); do echo $i; echo $i | sed 's/^/Did you hear about /g' | say; sleep 30; done

echosedawk · 2010-06-07 22:16:19 4
Get your external IP address

With a lolcat favicon if you access it from your browser Show Sample Output
This is sample output - yours may be different.
```
172.0.0.100
```
-2

curl icanhazip.com

pykler · 2010-06-14 18:47:11 3
get a list of top 1000 sites from alexa

this will dump a list of domains one per line into a text file
This is sample output - yours may be different.
-2

curl -s -O http://s3.amazonaws.com/alexa-static/top-1m.csv.zip ; unzip -q -o top-1m.csv.zip top-1m.csv ; head -1000 top-1m.csv | cut -d, -f2 | cut -d/ -f1 > topsites.txt

chrismccoy · 2010-11-01 01:25:53 4
‹ First < 6 7 8 9 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Equivalent to ifconfig -a in HPUX

Command is properly working on HP-UX 11.31

Getting the last argument from the previous command

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Get current Xorg resolution via xrandr

Not sure if it works the same on any shell.

Connect to SMTP server using STARTTLS

Allows you to connect to an SMTP server over TLS, which is useful for debugging SMTP sessions. (Much like telnet to 25/tcp). Once connected you can manually issue SMTP commands in the clear (e.g. EHLO)

One command line web server on port 80 using nc (netcat)

Very simple web server listening on port 80 will serve index.html file or whatever file you like pointing your browser at http://your-IP-address/index.html for example. If your web server is down for maintenance and you'd like to inform your visitors about it, quickly and easily, you just have to put into the index.html file the right HTML code and you are done! Of course you need to be root to run the command using port 80.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Compare two directories

Output of this command is the difference of recursive file lists in two directories (very quick!). To view differences in content of files too, use the command submitted by mariusbutuc (very slow!): $ diff -rq path_to_dir1 path_to_dir2

Calculates the date 2 weeks ago from Saturday the specified format.

Good for automating reports that need to run from between two dates.

enable all bash completions in gentoo

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged curl

Commands tagged curl (212) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged curl (212)

sorted by