Commands tagged website sorted by votes

Commands tagged website (8)

sorted by

Check availability of Websites based on HTTP_CODE
This is sample output - yours may be different.
8

urls=('www.ubuntu.com' 'google.com'); for i in ${urls[@]}; do http_code=$(curl -I -s $i -w %{http_code}); echo $i status: ${http_code:9:3}; done

Code_Bleu · 2009-08-17 16:24:26 0
Dump HTTP header using wget

Let me suggest using wget for obtaining the HTTP header only as the last resort because it generates considerable textual overhead. The first ellipsis of the sample output stands for Spider mode enabled. Check if remote file exists. --2009-03-31 20:42:46-- http://www.example.com/ Resolving www.example.com... 208.77.188.166 Connecting to www.example.com|208.77.188.166|:80... connected. HTTP request sent, awaiting response... and the second one looks for Length: 438 [text/html] Remote file exists and could contain further links, but recursion is disabled -- not retrieving. Show Sample Output
This is sample output - yours may be different.
```
&#8230;
  HTTP/1.1 200 OK
  Date: Tue, 31 Mar 2009 18:42:46 GMT
  Server: Apache/2.2.3 (CentOS)
  Last-Modified: Tue, 15 Nov 2005 13:24:10 GMT
  ETag: "b80f4-1b6-80bfd280"
  Accept-Ranges: bytes
  Content-Length: 438
  Connection: close
  Content-Type: text/html; charset=UTF-8
&#8230;
```
7

wget --server-response --spider http://www.example.com/

penpen · 2009-03-31 18:49:14 6
backup your entire hosted website using cPanel backup interface and wget

this will connect to your hosted website service through the cPanel interface and use its backup tool to backup and download the entire website, locally. (do not forget to replace : YourUsername , YourPassword and YourWebsiteUrl for it to work )
This is sample output - yours may be different.
5

wget --http-user=YourUsername --http-password=YourPassword http://YourWebsiteUrl:2082/getbackup/backup-YourWebsiteUrl-`date +"%-m-%d-%Y"`.tar.gz

nadavkav · 2009-03-31 17:50:41 1
website recursive offline mirror with wget

website recursive offline mirror with wget
This is sample output - yours may be different.
4

wget --mirror --convert-links --adjust-extension --page-requisites --recursive --no-parent www.example.com

aysadk · 2019-03-24 21:13:55 0
Check if a web page has changed last time checked.

Checks if a web page has changed. Put it into cron to check periodically. Change http://www.page.de/test.html and mail@mail.de for your needs.
This is sample output - yours may be different.
3

HTMLTEXT=$( curl -s http://www.page.de/test.html > /tmp/new.html ; diff /tmp/new.html /tmp/old.html ); if [ "x$HTMLTEXT" != x ] ; then echo $HTMLTEXT | mail -s "Page has changed." mail@mail.de ; fi ; mv /tmp/new.html /tmp/old.html

Emzy · 2010-07-04 21:45:37 1
Generate random sensible passwords, and copy them to the clipboard

Use the excellent sensiblepasswords.com to a generate random (yet easy-to-remember) password every second, and copy it to the clipboard. Useful for generating a list of passwords and pasting them into a spreadsheet. This script uses "madebynathan"'s "cb" function (http://madebynathan.com/2011/10/04/a-nicer-way-to-use-xclip/); you could also replace "cb" with xclip -selection c Remove "while true; do" and "; done" to generate and copy only 1 password. Show Sample Output
This is sample output - yours may be different.
```
Copied to clipboard: speedily702nixed
Copied to clipboard: rarities648toasting
Copied to clipboard: flunkies754inflect
Copied to clipboard: bogey202calves
^C
```
0

while true; do curl -s http://sensiblepassword.com/?harder=1 | tail -n 15 | head -n 1 | sed 's;<br/>;;' | cut -c 5- | cb; sleep 1; done

supervacuo · 2012-01-30 20:52:14 0
Find German synonyms using OpenThesaurus

A function for retrieving and displaying a list of synonyms for a German word or phrase. Show Sample Output
This is sample output - yours may be different.
```
$ desyno Läuterung
Aufbesserung, Aufwertung, Besserung, Läuterung, Melioration, Optimierung, Verbesserung, Verfeinerung, Vervollkommnung, Katharsis, Klärung, Läuterung, Reinigung
$ desyno linux
GNU/Linux, Linux
```
0

desyno(){ wget -q -O- https://www.openthesaurus.de/synonyme/search\?q\="$*"\&format\=text/xml | sed 's/>/>\n/g' | grep "<term term=" | cut -d \' -f 2 | paste -s -d , | sed 's/,/, /g' | fold -s -w $(tput cols); }

lordtoran · 2019-02-09 05:06:42 0
Dump HTTP header using lynx or w3m

Without the -dump option the header is displayed in lynx. You can also use w3m, the command then is w3m -dump_head http://www.example.com/ Show Sample Output
This is sample output - yours may be different.
```
HTTP/1.1 200 OK
Date: Tue, 31 Mar 2009 18:14:46 GMT
Server: Apache/2.2.3 (CentOS)
Last-Modified: Tue, 15 Nov 2005 13:24:10 GMT
ETag: "b80f4-1b6-80bfd280"
Accept-Ranges: bytes
Content-Length: 438
Connection: close
Content-Type: text/html; charset=UTF-8
```
-1

lynx -dump -head http://www.example.com/

penpen · 2009-03-31 18:41:36 1

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

convert unixtime to human-readable with awk

- convert unixtime to human-readable with awk - useful to read logfiles with unix-timestamps, f.e. squid-log: sudo tail -f /var/log/squid3/access.log | awk '{ print strftime("%c ", $1) $0; }

Kill all Zombie processes (Guaranteed!)

It identifies the parents of the Zombie processes and kill them. So the new parent of orphan Zombies will be the Init process and he is already waiting for reaping them. Be careful! It may also kill your useful processes just because they are not taking care and waiting for their children (bad parents!).

Set laptop display brightness

Run as root. Path may vary depending on laptop model and video card (this was tested on an Acer laptop with ATI HD3200 video). $ cat /proc/acpi/video/VGA/LCD/brightness to discover the possible values for your display.

ROT13 whole file in vim.

gg puts the cursor at the begin g? ROT13 until the next mov G the EOF

Terminal Keyboard Shortcut list

This command will give you a list of available keyboard shortcuts according to stty.

send a circular

Rename files in batch

Install pip with Proxy

Installs pip packages defining a proxy

skip broken piece of a loop but not exit the loop entirely

useful for loops like for i in $(cat list_of_servers); do ssh -q $i hostname; done if there is an unreachable server, you can just press ctrl + \ to skip that server and continue on with the loop

Use socat to emulate an SMTP mail SERVER

Lots of scripts show you how to use socat to send an email to an SMTP server; this command actually emulates an SMTP server! It assumes the client is only sending to one recipient, and it's not at all smart, but it'll capture the email into a log file and the client will stop retrying. I used this to diagnose what emails were being sent by cron and subsequently discarded, but you can use it for all sorts of things.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged website

Commands tagged website (8) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged website (8)

sorted by